Setup
Load required libraries for wrangling data, charting, and mapping
library(plyr,quietly = T) # data wrangling
library(dplyr,quietly = T) # data wrangling
library(ggplot2, quietly = T) # charting
library(ggthemes,quietly = T) # so I can add the highcharts theme and palette
library(scales,quietly = T) # to load the percent function when labeling plots
library(caret,quietly = T) # classification and regression training
library(foreach,quietly = T) # parallel processing to speed up the model training
library(doMC,quietly = T) # parallel processing to speed up the model training
library(lubridate,quietly = T) # for timing models
Set our preferred charting theme
theme_set(theme_minimal()+theme_hc()+theme(legend.key.width = unit(1.5, "cm")))
Run script to get hunter data
source('~/_code/colorado-dow/datasets/Colorado Elk Harvest Data.R', echo=F)
The working directory was changed to /Users/psarnow/_code/colorado-dow/datasets inside a notebook chunk. The working directory will be reset when the chunk is finished running. Use the knitr root.dir option in the setup chunk to change the working directory for notebook chunks.
Table of the harvest data
head(COElkRifleAll)
Unit Harvest.Antlered Hunters.Antlered Success.Antlered Season HuntCode Harvest.Antlerless Hunters.Antlerless Success.Antlerless Hunters.Either Success.Either Year
1 1 0 0 NA 1 EM001O1R NA NA NA NA NA 2006
2 2 0 0 NA 1 EM002O1R NA NA NA NA NA 2006
3 201 0 0 NA 1 EM201O1R NA NA NA NA NA 2006
4 3 0 0 NA 1 EM003O1R NA NA NA NA NA 2006
5 301 0 0 NA 1 EM301O1R NA NA NA NA NA 2006
6 4 0 0 NA 1 EM004O1R NA NA NA NA NA 2006
Run script to get draw data
source('~/_code/colorado-dow/datasets/Elk Drawing Summaries.R', echo=F)
Expected 26 pieces. Missing pieces filled with `NA` in 85 rows [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, ...].binding character and factor vector, coercing into character vectorExpected 26 pieces. Missing pieces filled with `NA` in 85 rows [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, ...].binding character and factor vector, coercing into character vectorExpected 26 pieces. Missing pieces filled with `NA` in 85 rows [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, ...].binding character and factor vector, coercing into character vectorExpected 26 pieces. Missing pieces filled with `NA` in 81 rows [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, ...].binding character and factor vector, coercing into character vectorThe working directory was changed to /Users/psarnow/_code/colorado-dow/datasets inside a notebook chunk. The working directory will be reset when the chunk is finished running. Use the knitr root.dir option in the setup chunk to change the working directory for notebook chunks.
Table of the data
head(COElkDrawAll)
HuntCode Orig_Quota Ttl_Chce_1 Chcs_Drawn Sex Unit Season Year Draw_Success
1 EE003O1R 1075 2188 1075 Either 3 1 2006 0.4913163
2 EE003O4R 300 533 300 Either 3 4 2006 0.5628518
3 EE004O4R 150 235 150 Either 4 4 2006 0.6382979
4 EE005O4R 10 33 10 Either 5 4 2006 0.3030303
5 EE006O1R 100 168 100 Either 6 1 2006 0.5952381
6 EE006O4R 80 83 80 Either 6 4 2006 0.9638554
source geodata
source('~/_code/colorado-dow/datasets/Colorado GMUnit and Road data.R', echo=F)
OGR data source with driver: ESRI Shapefile
Source: "/Users/psarnow/_code/colorado-dow/datasets/CPW_GMUBoundaries/BigGameGMUBoundaries03172015.shp", layer: "BigGameGMUBoundaries03172015"
with 185 features
It has 12 fields
Integer64 fields read as strings: GMUID
OGR data source with driver: ESRI Shapefile
Source: "/Users/psarnow/_code/colorado-dow/datasets/ne_10m_roads/ne_10m_roads.shp", layer: "ne_10m_roads"
with 56601 features
It has 29 fields
Integer64 fields read as strings: scalerank question
Take a peak at the boundary data
head(Unitboundaries2)
id long lat order hole piece group COUNTY DEERDAU ELKDAU ANTDAU MOOSEDAU BEARDAU LIONDAU SQ_MILES ACRES SHAPE_area SHAPE_len Unit
1 1 -109.0486 40.83476 1 FALSE 1 1.1 MOFFAT D-1 E-47 A-11 M-99 B-15 L-1 127.2227 81422.53 329506619 100751.7 1
2 1 -109.0472 40.83357 2 FALSE 1 1.1 MOFFAT D-1 E-47 A-11 M-99 B-15 L-1 127.2227 81422.53 329506619 100751.7 1
3 1 -109.0460 40.83295 3 FALSE 1 1.1 MOFFAT D-1 E-47 A-11 M-99 B-15 L-1 127.2227 81422.53 329506619 100751.7 1
4 1 -109.0449 40.83228 4 FALSE 1 1.1 MOFFAT D-1 E-47 A-11 M-99 B-15 L-1 127.2227 81422.53 329506619 100751.7 1
5 1 -109.0438 40.83204 5 FALSE 1 1.1 MOFFAT D-1 E-47 A-11 M-99 B-15 L-1 127.2227 81422.53 329506619 100751.7 1
6 1 -109.0423 40.83181 6 FALSE 1 1.1 MOFFAT D-1 E-47 A-11 M-99 B-15 L-1 127.2227 81422.53 329506619 100751.7 1
Set to predictive analytics directory
setwd("~/_code/colorado-dow/phase III - predictive analytics")
Organize data
Will start by grouping all of the seasons together, and modeling the number of hunters per Year and Unit
Group Draw results data by Year and Unit
COElkDraw_Unit <- summarise(group_by(COElkDrawAll,Year,Unit,Season),
Quota = sum(Orig_Quota,na.rm = T),
Drawn = sum(Chcs_Drawn,na.rm = T))
Appropriate field classes for model training
COElkDraw_Unit$Year <- as.numeric(COElkDraw_Unit$Year)
Group Hunter data by Year and Unit
COElkHunters_Unit <- summarise(group_by(COElkRifleAll,Year,Unit,Season),
Hunters = sum(c(Hunters.Antlered,Hunters.Antlerless,Hunters.Either),na.rm = T))
COElkHunters_Unit$Year <- as.numeric(COElkHunters_Unit$Year)
Join in Hunter and Draw data together
COElkHunters_Unit <- left_join(COElkHunters_Unit, COElkDraw_Unit, by = c("Year","Unit","Season"))
Replace the draw data that don’t have entries with 0
COElkHunters_Unit$Drawn[is.na(COElkHunters_Unit$Drawn)] <- 0
COElkHunters_Unit$Quota[is.na(COElkHunters_Unit$Quota)] <- 0
Split into train and test sets. Will use 75% of the data to train on.
COElkHunters_Unit <- mutate(group_by(COElkHunters_Unit,Unit),
numentries = n())
COElkHunters_Unit <- filter(COElkHunters_Unit, numentries >= 3)
COElkHunters_Unit$UnitYearSeason <- paste(COElkHunters_Unit$Unit, COElkHunters_Unit$Year,COElkHunters_Unit$Season)
traindata2 <- COElkHunters_Unit %>% group_by(Unit) %>% sample_frac(size = .75, replace = F)
testdata2 <- COElkHunters_Unit[!COElkHunters_Unit$UnitYearSeason %in% traindata2$UnitYearSeason,]
COElkHunters_Unit <- select(COElkHunters_Unit, -UnitYearSeason, -numentries)
traindata2 <- select(traindata2, -UnitYearSeason, -numentries)
testdata2 <- select(testdata2, -UnitYearSeason, -numentries)
Save off for importing into AzureML
Data Visualization
notice that the number of hunters data is skewed.
ggplot(COElkHunters_Unit, aes(Hunters)) +
geom_density() +
xlab("Hunters in Unit") +
ylab("Number of Units") +
theme(axis.text.y = element_blank()) +
labs(title="Distribution of Hunters in each Unit", subtitle="2006-2017", caption="source: cpw.state.co.us")

A general rule of thumb to consider is that skewed data whose ratio of the highest value to the lowest value is greater than 20 have significant skewness. Also, the skewness statistic can be used as a diagnostic. If the predictor distribution is roughly symmetric, the skewness values will be close to zero. As the distribution becomes more right skewed, the skewness statistic becomes larger. Similarly, as the distribution becomes more left skewed, the value becomes negative. Replacing the data with the log, square root, or inverse may help to remove the skew.
Example of how BoxCox can redistribute the data
preProcValues2 <- preProcess(as.data.frame(traindata2), method = "BoxCox")
trainBC <- predict(preProcValues2, as.data.frame(traindata2))
ggplot(trainBC, aes(Hunters)) +
geom_density() +
xlab("BoxCox Hunters in Unit") +
ylab("Number of Units") +
theme(axis.text.y = element_blank()) +
labs(title="BoxCox Distribution of Hunters in each Unit", subtitle="2006-2017", caption="source: cpw.state.co.us")
caret has a preproccess function for correcting for skewness ‘BoxCox’, we will need to be sure to look at using this function in the training models.
Model Building
Model Training Methods
Loop through possible methods, utilizing the quicker ‘adaptive_cv’ parameter search from caret. Consider scripting this into AzureML to make it run much faster, though there is more setup and errors to control for
quickmethods <- c("lm",'svmLinear',"svmRadial","knn","cubist","kknn","glm.nb")
step1_all_Unit <- NULL
for (imethod in quickmethods) {
step1_Unit <- NULL
start <- now()
# if (imethod == "lm") {
# controlmethod <- "repeatedcv"
# } else {controlmethod <- "adaptive_cv"}
controlmethod <- "repeatedcv"
fitControl <- trainControl(
method = controlmethod,
# search = 'random',
number = 4,
repeats = 4,
allowParallel = TRUE,
summaryFunction = defaultSummary)
registerDoSEQ()
registerDoMC(cores = 6)
HuntersModel_1_Unit = train(Hunters ~ ., data = traindata2,
method = imethod,
tuneLength = 15,
trControl = fitControl)
HuntersModel_1_Unit
# measure performance
predictdata <- predict(HuntersModel_1_Unit, testdata2)
step1_Unit$method <- imethod
step1_Unit$RMSE <- postResample(pred = predictdata, obs = testdata2$Hunters)[1]
step1_Unit$duration <- now() - start
step1_Unit <- as.data.frame(step1_Unit)
step1_all_Unit <- rbind(step1_all_Unit,step1_Unit)
}
Timing stopped at: 0.033 0.007 0.04
View Results, and compare to previous first models that did not expand to Seasons
step1_all
method RMSE duration
RMSE lm 165.0025 6.866598 secs
RMSE1 svmLinear 178.0942 4.950974 secs
RMSE2 svmRadial 134.0561 22.081016 secs
RMSE3 knn 733.8210 10.502875 secs
RMSE4 cubist 151.9572 3.057477 secs
RMSE5 kknn 132.0211 9.778734 secs
RMSE6 cubist 160.5464 1.027274 secs
step1_all_Unit
method RMSE duration
RMSE lm 153.05547 4.228410 secs
RMSE1 svmLinear 162.67004 35.926092 secs
RMSE2 svmRadial 62.73800 11.961980 secs
RMSE3 knn 70.93077 2.446104 secs
RMSE4 cubist 68.93277 4.504099 secs
RMSE5 kknn 58.81122 7.604784 secs
RMSE6 glm.nb 164.19801 25.610913 secs
The performance RMSE metric is certainly improved when including the Seasonal grouping. Lets take the best method, and see if it is visually reasonable while also charting without Seasons.
Predictions using best Season model
Build model
controlmethod <- "repeatedcv"
fitControl <- trainControl(
method = controlmethod,
# search = 'random',
number = 4,
repeats = 4,
allowParallel = TRUE,
summaryFunction = defaultSummary)
registerDoSEQ()
registerDoMC(cores = 6)
HuntersModel_1_Unit = train(Hunters ~ ., data = COElkHunters_Unit,
method = "kknn",
# preProc = c("center","scale"),
tuneLength = 15,
trControl = fitControl)
Predict Hunter for next year, 2018
COElkHunters2018_Unit <- COElkHunters_Unit
COElkHunters2018_Unit$Unit_Season <- paste(COElkHunters2018_Unit$Unit,COElkHunters2018_Unit$Season)
COElkHunters2018_Unit <- as.data.frame(unique(COElkHunters2018_Unit$Unit_Season))
colnames(COElkHunters2018_Unit) <- "Unit_Season"
# Fill in missing Units and Seasons per unique Unit_Seasons
COElkHunters2018_Unit$Unit <- str_extract(COElkHunters2018_Unit$Unit_Season,"[:alnum:]+(?=[:blank:])")
COElkHunters2018_Unit$Season <- str_extract(COElkHunters2018_Unit$Unit_Season,"(?<=[:blank:])[:alnum:]+")
COElkHunters2018_Unit <- select(COElkHunters2018_Unit, -Unit_Season)
COElkHunters2018_Unit$Year <- 2018
# Draw data for 2018
COElkDraw_Unit2018 <- filter(COElkDraw_Unit,Year==2018)
# A left join will autofill missing draw data with NAs, but will retain the full list of Unit Seasons
COElkHunters2018_Unit <- left_join(COElkHunters2018_Unit,COElkDraw_Unit2018)
Joining, by = c("Unit", "Season", "Year")
# Replace the draw data that don't have entries with 0
COElkHunters2018_Unit$Drawn[is.na(COElkHunters2018_Unit$Drawn)] <- 0
COElkHunters2018_Unit$Quota[is.na(COElkHunters2018_Unit$Quota)] <- 0
# Only use the fields that were included in the model
COElkHunters2018_Unit <- COElkHunters2018_Unit[, colnames(COElkHunters2018_Unit) %in% c("Unit","Season",HuntersModel_1_Unit$coefnames)]
# Use trained model to predict Hunters
COElkHunters2018_Unit$Hunters <- round(predict(HuntersModel_1_Unit, COElkHunters2018_Unit))
COElkHunters2018_Unit$Hunters[COElkHunters2018_Unit$Hunters<0] <- 0
Label and Join models together for comparisons
Hunterscompare <- rbind(Hunterscompare,Hunterscompare_Season)
Error in bind_rows_(x, .id) : Argument 1 must have names
# Group Units
HunterscompareStatewide <- summarise(group_by(Hunterscompare,Year,modeldata),
Hunters = sum(Hunters))
ggplot(HunterscompareStatewide, aes(Year,Hunters,group=modeldata,fill=modeldata)) +
geom_bar(position="dodge",stat="identity") +
coord_cartesian(ylim = c(130000,155000)) +
scale_fill_hc() +
labs(title="Statewide Elk Hunters", caption="source: cpw.state.co.us")

Hunters Statewide by Season and Year
Hunters_Season <- rbind.fill(COElkHunters_Unit,COElkHunters2018_Unit)
ggplot(Hunters_Season, aes(Year,Hunters,group=Season,fill=Season)) +
geom_bar(position="dodge",stat="identity") +
# coord_cartesian(ylim = c(130000,155000)) +
scale_fill_hc() +
labs(title="Statewide Elk Hunters", caption="source: cpw.state.co.us")

Hunters …. other charts?
Keep going by creating models for hunters per year, unit and season?
top_two_models <- top_n(step1_all,2,-RMSE)$method
More Model Training Methods
Take the top two and determine some additonal methods to try by maximizing the Jaccard dissimilarity between sets of models
tag <- read.csv("tag_data.csv", row.names = 1)
tag <- as.matrix(tag)
Select only models for regression
regModels <- tag[tag[,"Regression"] == 1,]
all <- 1:nrow(regModels)
dissimilarmethods_all <- NULL
for (itoptwo in 1:2) {
## Seed the analysis with the model of interest
start <- grep(top_two_models[itoptwo], rownames(regModels), fixed = TRUE)
pool <- all[all != start]
## Select 4 model models by maximizing the Jaccard
## dissimilarity between sets of models
nextMods <- maxDissim(regModels[start,,drop = FALSE],
regModels[pool, ],
method = "Jaccard",
n = 4)
rownames(regModels)[c(nextMods)]
dissimilarmethods <- rownames(regModels)[nextMods]
dissimilarmethods <- str_extract(string = dissimilarmethods,pattern = "[:alnum:]+(?=\\))")
dissimilarmethods_all <- c(dissimilarmethods_all,dissimilarmethods)
}
Now we have 8 more methods to try in the same manner
dissimilarmethods_all <- unique(dissimilarmethods_all)
dissimilarmethods_all
for (imethod in dissimilarmethods_all) {
step1 <- NULL
start_timer <- now()[1]
if (imethod == "lm") {
controlmethod <- "repeatedcv"
} else {controlmethod <- "adaptive_cv"}
fitControl <- trainControl(
method = controlmethod,
# search = 'random',
number = 4,
repeats = 4,
allowParallel = TRUE,
summaryFunction = defaultSummary)
registerDoSEQ()
registerDoMC(cores = 6)
HuntersModel_1 = train(Hunters ~ ., data = traindata,
method = imethod,
preProc = c("center","scale"),
tuneLength = 15,
trControl = fitControl)
HuntersModel_1
# measure performance
predictdata <- predict(HuntersModel_1, testdata)
step1$method <- imethod
step1$RMSE <- postResample(pred = predictdata, obs = testdata$Hunters)[1]
step1$duration <- now()[1] - start_timer[1]
step1 <- as.data.frame(step1)
step1_all <- rbind(step1_all,step1)
}
step1_all
Preprocessing on Top Modeling Methods
Now lets work on some refined tuning on the top methods Any valuable preprocessing steps?
preprocessfunctions <- c("BoxCox", "YeoJohnson", "expoTrans", "center", "scale", "range", "knnImpute", "bagImpute", "medianImpute", "pca", "ica", "spatialSign", "corr", "zv", "nzv")
topmethods <- top_n(step1_all,2,-RMSE)$method
fitControl <- trainControl(
method = "adaptive_cv", #repeatedcv,
search = 'random',
number = 10, #4
repeats = 10, #10
# classProbs = TRUE,
# savePred = TRUE,
allowParallel = TRUE,
summaryFunction = defaultSummary)
PPperformance_all <- NULL
PPperformance <- NULL
for (imethod in topmethods) {
for (ipreprocess in preprocessfunctions) {
registerDoSEQ()
registerDoMC(cores = 6)
PreProcessModel = train(Hunters ~ ., data = traindata,
method = imethod,
preProc = ipreprocess,
#tuneLength = 10,
#tuneGrid = kknnTuneGrid,
trControl = fitControl)
print(PreProcessModel)
# check performance
predictdata <- predict(PreProcessModel, testdata)
PPperformance$method <- imethod
PPperformance$preprocess <- ipreprocess
PPperformance$RMSE <- postResample(pred = predictdata, obs = testdata$Hunters)[1]
PPperformance <- as.data.frame(PPperformance)
PPperformance_all <- rbind(PPperformance_all,PPperformance)
}
}
# Some of the models were loaded into AzureML and processed there.
# Output from AzureML
# [ModuleOutput] method preprocess RMSE
# [ModuleOutput] RMSE kknn BoxCox 130.7939
# [ModuleOutput] RMSE1 kknn YeoJohnson 130.9600
# [ModuleOutput] RMSE2 kknn center 130.7331
# [ModuleOutput] RMSE3 kknn scale 130.1818
# [ModuleOutput] RMSE4 kknn pca 130.2071
# [ModuleOutput] RMSE5 svmRadial BoxCox 154.0898
# [ModuleOutput] RMSE6 svmRadial YeoJohnson 169.9816
# [ModuleOutput] RMSE7 svmRadial center 154.1891
# [ModuleOutput] RMSE8 svmRadial scale 154.1000
# [ModuleOutput] RMSE9 svmRadial pca 164.0881
# svmRadial and kknn don't perform better with any of the preprocessing functions in place
PPperformance_all
Model Predictors
Now we can review the predictors, there are only a few fields so I will manually test performance while excluding each of them to monitor their importance. Some of our fields are instinctively required (Year, Unit)
Predictors <- c("Quota","Drawn")
Predictorperformance_all <- NULL
Predictorperformance <- NULL
for (imethod in topmethods) {
for (ipredictor in Predictors) {
registerDoSEQ()
registerDoMC(cores = 6)
PredictorModel = train(Hunters ~ ., data = select(traindata,-ipredictor),
method = imethod,
tuneLength = 15,
trControl = fitControl)
print(PredictorModel)
# check performance
predictdata <- predict(PredictorModel, testdata)
Predictorperformance$method <- imethod
Predictorperformance$missing_predictor <- ipredictor
Predictorperformance$RMSE <- postResample(pred = predictdata, obs = testdata$Hunters)[1]
Predictorperformance <- as.data.frame(Predictorperformance)
Predictorperformance_all <- rbind(Predictorperformance_all,Predictorperformance)
}
}
Predictorperformance_all
svMRadial will perform better with all of the predictors, while kknn performs better with only Unit and Year fields
Use above information to test out various combinations of preprocessing and predictor sets
kknn
kknn without Quota and Drawn
fitControl <- trainControl(
method = "adaptive_cv", #repeatedcv,
search = 'random',
number = 10, #4
repeats = 10, #10
# classProbs = TRUE,
# savePred = TRUE,
allowParallel = TRUE,
summaryFunction = defaultSummary)
registerDoSEQ()
registerDoMC(cores = 6)
kknnModel = train(Hunters ~ ., data = select(COElkHunters,-Quota, -Drawn),
method = "kknn",
tuneLength = 75,
trControl = fitControl)
kknnModel
Best RMSE
# not sure why caret is selecting parameters with higher RMSE, lets select manually
RSMEkknn <- filter(kknnModel$results, RMSE == min(RMSE))
RSMEkknn$kernel <- as.character(RSMEkknn$kernel)
RSMEkknn
Model Tuning
run again with a tune grid
kknnTuneGrid <- data.frame(kmax = c(RSMEkknn$kmax,RSMEkknn$kmax,RSMEkknn$kmax,RSMEkknn$kmax,RSMEkknn$kmax),
distance = c(RSMEkknn$distance*.7,RSMEkknn$distance*.9,RSMEkknn$distance,RSMEkknn$distance*1.1,RSMEkknn$distance*1.3),
kernel = c(RSMEkknn$kernel,RSMEkknn$kernel,RSMEkknn$kernel,RSMEkknn$kernel,RSMEkknn$kernel))
fitControl <- trainControl(
method = "repeatedcv", #repeatedcv,
number = 10, #4
repeats = 10, #10
allowParallel = TRUE,
summaryFunction = defaultSummary)
registerDoSEQ()
registerDoMC(cores = 6)
kknnGridModel = train(Hunters ~ ., data = select(COElkHunters,-Quota, -Drawn),
method = "kknn",
tuneGrid = kknnTuneGrid,
trControl = fitControl)
kknnGridModel
Best RMSE
RSMEkknn <- filter(kknnGridModel$results, RMSE == min(RMSE))
RSMEkknn$kernel <- as.character(RSMEkknn$kernel)
run again with a tune grid
kknnTuneGrid2 <- data.frame(kmax = c(RSMEkknn$kmax*.7,RSMEkknn$kmax*.9,RSMEkknn$kmax,RSMEkknn$kmax*1.1,RSMEkknn$kmax*1.3),
distance = c(RSMEkknn$distance,RSMEkknn$distance,RSMEkknn$distance,RSMEkknn$distance,RSMEkknn$distance),
kernel = c(RSMEkknn$kernel,RSMEkknn$kernel,RSMEkknn$kernel,RSMEkknn$kernel,RSMEkknn$kernel))
registerDoSEQ()
registerDoMC(cores = 6)
kknnGridModel2 = train(Hunters ~ ., data = select(COElkHunters,-Quota, -Drawn),
method = "kknn",
tuneGrid = kknnTuneGrid2,
trControl = fitControl)
kknnGridModel2
One more time on final parameter (kernel) Best RMSE
RSMEkknn <- filter(kknnGridModel2$results, RMSE == min(RMSE))[1,]
kernels <- levels(kknnModel$results$kernel)
run again with a tune grid
kknnTuneGrid3 <- data.frame(kmax = rep(465.0,8),
distance = rep(0.1395586,8),
kernel = kernels)
registerDoSEQ()
registerDoMC(cores = 6)
kknnGridModel3 = train(Hunters ~ ., data = select(COElkHunters,-Quota, -Drawn),
method = "kknn",
tuneGrid = kknnTuneGrid3,
trControl = fitControl)
kknnGridModel3
RSMEkknn <- filter(kknnGridModel3$results, RMSE == min(RMSE))
Best RMSE for kknn thus far
RSMEkknn <- filter(kknnModel$results, RMSE == min(RMSE))
Work thru some resampling methods with best kknn params
kknnTuneGrid4 <- data.frame(kmax = RSMEkknn$kmax,
distance = RSMEkknn$distance,
kernel = as.character(RSMEkknn$kernel))
trainmethods <- c("boot", "boot632", "optimism_boot", "boot_all", "cv", "repeatedcv", "LOOCV", "LGOCV", "none")
trainmethodperformance_all <- NULL
for (itrainmethod in trainmethods) {
trainmethodperformance <- NULL
fitControl <- trainControl(
method = itrainmethod,
number = 10, #4
repeats = 10, #10
allowParallel = TRUE,
summaryFunction = defaultSummary)
registerDoSEQ()
registerDoMC(cores = 6)
kknnTrainModel = train(Hunters ~ ., data = select(COElkHunters,-Quota, -Drawn),
method = "kknn",
tuneGrid = kknnTuneGrid4,
trControl = fitControl)
print(kknnTrainModel)
trainmethodperformance <- filter(kknnTrainModel$results, RMSE == min(RMSE))
trainmethodperformance$trainmethod <- itrainmethod
trainmethodperformance_all <- rbind.fill(trainmethodperformance_all,trainmethodperformance)
}
trainmethodperformance_all
fitControl <- trainControl(
method = "optimism_boot",
number = 10, #4
allowParallel = TRUE,
summaryFunction = defaultSummary)
kknnFinalTrainModel = train(Hunters ~ ., data = COElkHunters,
method = "kknn",
tuneGrid = kknnTuneGrid4,
trControl = fitControl)
save off for future loading
save(kknnFinalTrainModel, file = "~/_code/colorado-dow/datasets/kknnFinalTrainModel.RData")
run again with a tune grid
svmRadTuneGrid <- data.frame(.sigma = c(0.0037653,0.0037653,0.0037653,0.0037653,0.0037653),
.C = c(2048*.7,2048*.9,2048,2048*1.1,2048*1.3))
fitControl <- trainControl(
method = "repeatedcv", #repeatedcv,
number = 10, #4
repeats = 10, #10
allowParallel = TRUE,
summaryFunction = defaultSummary)
registerDoSEQ()
registerDoMC(cores = 6)
svmRadGridModel = train(Hunters ~ ., data = COElkHunters,
method = "svmRadial",
tuneGrid = svmRadTuneGrid,
trControl = fitControl)
svmRadGridModel
Best RMSE, not sure why caret is selecting parameters with higher RMSE, lets select manually
RSMEsvmRad <- filter(svmRadGridModel$results, RMSE == min(RMSE))
run again with a tune grid
svmRadTuneGrid2 <- data.frame(.sigma = c(RSMEsvmRad$sigma*.7,RSMEsvmRad$sigma*.9,RSMEsvmRad$sigma,RSMEsvmRad$sigma*1.1,RSMEsvmRad$sigma*1.3),
.C = c(RSMEsvmRad$C,RSMEsvmRad$C,RSMEsvmRad$C,RSMEsvmRad$C,RSMEsvmRad$C))
registerDoSEQ()
registerDoMC(cores = 6)
svmRadGridModel2 = train(Hunters ~ ., data = COElkHunters,
method = "svmRadial",
tuneGrid = svmRadTuneGrid2,
trControl = fitControl)
svmRadGridModel2
RSMEsvmRad <- filter(svmRadGridModel2$results, RMSE == min(RMSE))
Work thru some resampling methods with best kknn params
svmRadTuneGrid3 <- data.frame(.sigma = RSMEsvmRad$sigma,
.C = RSMEsvmRad$C)
trainmethods <- c("boot", "boot632", "optimism_boot", "cv", "repeatedcv", "LOOCV", "LGOCV", "none")
trainmethodperformance_all <- NULL
for (itrainmethod in trainmethods) {
trainmethodperformance <- NULL
fitControl <- trainControl(
method = itrainmethod,
number = 10, #4
repeats = 10, #10
allowParallel = TRUE,
summaryFunction = defaultSummary)
registerDoSEQ()
registerDoMC(cores = 6)
svmRadTrainModel = train(Hunters ~ ., data = COElkHunters,
method = "svmRadial",
tuneGrid = svmRadTuneGrid3,
trControl = fitControl)
print(svmRadTrainModel)
trainmethodperformance <- filter(svmRadTrainModel$results, RMSE == min(RMSE))
trainmethodperformance$trainmethod <- itrainmethod
trainmethodperformance_all <- rbind.fill(trainmethodperformance_all,trainmethodperformance)
}
trainmethodperformance_all
fitControl <- trainControl(
method = "optimism_boot",
number = 10, #4
allowParallel = TRUE,
summaryFunction = defaultSummary)
svmRadFinalTrainModel = train(Hunters ~ ., data = COElkHunters,
method = "svmRadial",
tuneGrid = svmRadTuneGrid3,
trControl = fitControl)
save off for future loading
save(svmRadFinalTrainModel, file = "~/_code/colorado-dow/datasets/svmRadFinalTrainModel.RData")
back to train vs test data for one more performance measure and chart… even though for future data we will use the final trained model
svmRadTrainModel = train(Hunters ~ ., data = traindata,
method = "svmRadial",
tuneGrid = svmRadTuneGrid3,
trControl = fitControl)
check performance
predictdata <- predict(svmRadTrainModel, testdata)
postResample(pred = predictdata, obs = testdata$Hunters)
Chart performance of predicted
chartperformance <- data.frame(predicted = predictdata, observed = testdata$Hunters)
ggplot(chartperformance, aes(predicted,observed)) +
geom_point() +
labs(title="Performance of Number of Hunters Prediction", caption="source: cpw.state.co.us")
kknn performed better than svmRadial RMSE=130 vs 154
FinalHuntersmodel <- kknnFinalTrainModel
# FinalHuntersmodel <- svmRadFinalTrainModel
save(FinalHuntersmodel, file = "~/_code/colorado-dow/datasets/FinalHuntersmodel.RData")
Use the 2018 Draw data to predict the number of hunters in 2018
COElkDraw2018 <- filter(COElkDraw, Year == 2018)
COElkHunters2018 <- COElkDraw2018[, colnames(COElkDraw2018) %in% c("Unit",FinalHuntersmodel$coefnames)]
COElkHunters2018 <- as.data.frame(unique(COElkHunters$Unit))
colnames(COElkHunters2018) <- "Unit"
COElkHunters2018$Year <- 2018
COElkHunters2018 <- left_join(COElkHunters2018,filter(COElkDraw,Year==2018))
# Replace the draw data that don't have entries with 0
COElkHunters2018$Drawn[is.na(COElkHunters2018$Drawn)] <- 0
COElkHunters2018$Quota[is.na(COElkHunters2018$Quota)] <- 0
COElkHunters2018 <- COElkHunters2018[, colnames(COElkHunters2018) %in% c("Unit",FinalHuntersmodel$coefnames)]
COElkHunters2018$Hunters <- round(predict(FinalHuntersmodel, COElkHunters2018))
COElkHunters2018$Hunters[COElkHunters2018$Hunters<0] <- 0
Save off so we don’t have to recreate the model everytime we want the results
save(COElkHunters2018,file="COElkHunters2018.RData")
Total Elk Harvest
Statewide
Group seasons
COElkHuntersStatewide <- summarise(group_by(COElkRifleAll,Year,Unit),
Hunters = sum(c(Hunters.Antlered,Hunters.Antlerless,Hunters.Either),na.rm = T))
COElkHunters2018b <- COElkHunters2018
# COElkHunters2018b$Year <- as.character(COElkHunters2018b$Year)
# Join 2018 to historic data
COElkHuntersAll <- rbind.fill(COElkHuntersStatewide,COElkHunters2018b)
# Group Units
COElkHuntersStatewide <- summarise(group_by(COElkHuntersAll,Year),
Hunters = sum(Hunters))
ggplot(COElkHuntersStatewide, aes(Year,Hunters)) +
geom_bar(stat="identity",fill=ggthemes_data$hc$palettes$default[2]) +
coord_cartesian(ylim = c(130000,155000)) +
labs(title="Statewide Elk Hunters", caption="source: cpw.state.co.us")
TODO commentary
Hunters by Unit
I’d like to know where the hunters are distributed across the state.
Next year’s data
Year2018 <- filter(COElkHuntersAll, Year == "2018")
HunterstoPlot <- left_join(Unitboundaries2,Year2018, by=c("Unit"))
ggplot(HunterstoPlot, aes(long, lat, group = group)) +
geom_polygon(aes(fill = Hunters),colour = "grey50", size = .2) + #Unit boundaries
geom_path(data = COroads,aes(x = long, y = lat, group = group), color="#3878C7",size=2) + #Roads
geom_text(data=data_centroids,aes(x=longitude,y=latitude,label = Unit),size=3) + #Unit labels
scale_fill_distiller(palette = "Oranges",direction = 1,na.value = 'light grey') +
xlab("") + ylab("") +
labs(title="Predicted 2018 Colorado Elk Hunters", caption="source: cpw.state.co.us")
TODO - commentary
Year to Year Hunter Trends
Create a png of each year
icounter <- 0
for (imap in unique(COElkHuntersAll$Year)){
# Colorado aspect ratio = 1087w x 800h -> 1.35875
# Use trial and error to determine which width and height to define for png files that will retain the correct aspect ratio
png(file=paste("HuntersMap",imap,".png"), width=948, height=700)
yearplot <- filter(COElkHuntersAll, Year == imap)
HunterstoPlot <- left_join(Unitboundaries2,yearplot, by=c("Unit"))
p1 <- ggplot(HunterstoPlot, aes(long, lat, group = group)) +
geom_polygon(aes(fill = Hunters),colour = "grey50", size = .2) + #Unit boundaries
geom_path(data = COroads,aes(x = long, y = lat, group = group), color="#3878C7",size=2) + #Roads
geom_text(data=data_centroids,aes(x=longitude,y=latitude,label = Unit),size=5) + #Unit labels
scale_fill_distiller(palette = "Oranges",
direction = 1,
na.value = 'light grey',
limits = c(0,max(COElkHuntersAll$Hunters))) + #fix so each year chart has same color breaks
xlab("") + ylab("") +
theme(plot.title=element_text(hjust = .5)) +
theme(plot.subtitle=element_text(hjust = icounter/length(unique(COElkHuntersAll$Year)))) +
labs(title="Colorado Elk Hunters", subtitle=imap, caption="source: cpw.state.co.us")
plot(p1)
dev.off()
icounter <- icounter + 1
}
Convert the .png files to one .gif file using ImageMagick.
system("convert -delay 150 *.png HuntersmapPred.gif")
> TODO - commentary
Remove the .png files
file.remove(list.files(pattern=".png"))
Number of Hunters Rank of the Units
Would also be beneficial to rank each unit so I can reference later. In this case average the number of hunters of the last few years
HunterRank2018 <- filter(COElkHuntersAll, as.numeric(Year) == 2018)
HunterRank2018 <- summarise(group_by(HunterRank2018,Unit),
Hunters = mean(Hunters,na.rm = T))
HunterRank2018$HuntersRank = rank(-HunterRank2018$Hunters)
HunterRank2018 <- filter(HunterRank2018, HuntersRank <= 50) # top 50 units
# In order for the chart to retain the order of the rows, the X axis variable (i.e. the categories) has to be converted into a factor.
HunterRank2018 <- HunterRank2018[order(-HunterRank2018$Hunters), ] # sort
HunterRank2018$Unit <- factor(HunterRank2018$Unit, levels = HunterRank2018$Unit) # to retain the order in plot.
Lollipop Chart
ggplot(HunterRank2018, aes(x=Unit, y=Hunters)) +
geom_point(size=3) +
geom_segment(aes(x=Unit,
xend=Unit,
y=0,
yend=Hunters)) +
labs(title="Predicted Elk Hunters 2018\nTop 50 Units", subtitle="Hunters by Unit", caption="source: cpw.state.co.us")
TODO - commentary
LS0tCnRpdGxlOiAiUHJlZGljdCBOdW1iZXIgb2YgRnV0dXJlIEVsayBIdW50ZXJzIHBlciBVbml0IFNlYXNvbiIKYXV0aG9yOiAiUGllcnJlIFNhcm5vdyIKb3V0cHV0OgogIGh0bWxfbm90ZWJvb2s6CiAgICB0b2M6IHllcwogICAgdG9jX2Zsb2F0OiBmYWxzZQogICAgdG9jX2RlcHRoOiA2CiAgICB0aGVtZTogeWV0aQogICAgaGlnaHRsaWdodDogZGVmYXVsdAogICAgY29kZV9mb2xkaW5nOiBub25lCi0tLQoKCioqKgojIyBEZXNjcmlwdGlvbgpVc2UgaGlzdG9yaWNhbCBkcmF3IHJlc3VsdHMsIGFuZCBudW1iZXIgb2YgaHVudGVycyB0byB0cmFpbiBhIG1vZGVsIHdlIGNhbiB1c2UgdG8gCnByZWRpY3QgdGhlIG51bWJlciBvZiBodW50ZXJzIGluIGZ1dHVyZSB5ZWFycy4gSSB3b3VsZCBsaWtlIHRvIGNvbXBhcmUgdGhpcyB0byB0aGUgcmVzdWx0cwp3ZSBnZW5lcmF0ZWQgYnkgZ3JvdXBpbmcgdGhlIHNlYXNvbnMgdG9nZXRoZXIuIAoKCipfX05PVElDRV9fIHRoYXQgSSBhbSBvbmx5IGxvb2tpbmcgYXQgdGhlIGdlbmVyYWwgcmlmbGUgaHVudGluZyBzZWFzb25zIG9uIHB1YmxpYyBsYW5kLiBUaGVyZSBhcmUgYWxzbyAKaHVudGVycyBmb3IgQXJjaGVyeSwgTXV6emxlbG9hZGVyLCBQcml2YXRlIExhbmQsIFJhbmNoaW5nIGZvciBXaWxkbGlmZSwgZXRjLioKCioqKgojIyBTZXR1cApMb2FkIHJlcXVpcmVkIGxpYnJhcmllcyBmb3Igd3JhbmdsaW5nIGRhdGEsIGNoYXJ0aW5nLCBhbmQgbWFwcGluZwpgYGB7cn0KbGlicmFyeShwbHlyLHF1aWV0bHkgPSBUKSAjIGRhdGEgd3JhbmdsaW5nCmxpYnJhcnkoZHBseXIscXVpZXRseSA9IFQpICMgZGF0YSB3cmFuZ2xpbmcKbGlicmFyeShnZ3Bsb3QyLCBxdWlldGx5ID0gVCkgIyBjaGFydGluZwpsaWJyYXJ5KGdndGhlbWVzLHF1aWV0bHkgPSBUKSAjIHNvIEkgY2FuIGFkZCB0aGUgaGlnaGNoYXJ0cyB0aGVtZSBhbmQgcGFsZXR0ZQpsaWJyYXJ5KHNjYWxlcyxxdWlldGx5ID0gVCkgIyB0byBsb2FkIHRoZSBwZXJjZW50IGZ1bmN0aW9uIHdoZW4gbGFiZWxpbmcgcGxvdHMKbGlicmFyeShjYXJldCxxdWlldGx5ID0gVCkgIyBjbGFzc2lmaWNhdGlvbiBhbmQgcmVncmVzc2lvbiB0cmFpbmluZwpsaWJyYXJ5KGZvcmVhY2gscXVpZXRseSA9IFQpICMgcGFyYWxsZWwgcHJvY2Vzc2luZyB0byBzcGVlZCB1cCB0aGUgbW9kZWwgdHJhaW5pbmcKbGlicmFyeShkb01DLHF1aWV0bHkgPSBUKSAjIHBhcmFsbGVsIHByb2Nlc3NpbmcgdG8gc3BlZWQgdXAgdGhlIG1vZGVsIHRyYWluaW5nCmxpYnJhcnkobHVicmlkYXRlLHF1aWV0bHkgPSBUKSAjIGZvciB0aW1pbmcgbW9kZWxzCmBgYAoKU2V0IG91ciBwcmVmZXJyZWQgY2hhcnRpbmcgdGhlbWUKYGBge3J9CnRoZW1lX3NldCh0aGVtZV9taW5pbWFsKCkrdGhlbWVfaGMoKSt0aGVtZShsZWdlbmQua2V5LndpZHRoID0gdW5pdCgxLjUsICJjbSIpKSkKYGBgIAoKUnVuIHNjcmlwdCB0byBnZXQgaHVudGVyIGRhdGEKYGBge3J9CnNvdXJjZSgnfi9fY29kZS9jb2xvcmFkby1kb3cvZGF0YXNldHMvQ29sb3JhZG8gRWxrIEhhcnZlc3QgRGF0YS5SJywgZWNobz1GKQpgYGAKClRhYmxlIG9mIHRoZSBoYXJ2ZXN0IGRhdGEKYGBge3J9CmhlYWQoQ09FbGtSaWZsZUFsbCkKYGBgCgoKUnVuIHNjcmlwdCB0byBnZXQgZHJhdyBkYXRhCmBgYHtyfQpzb3VyY2UoJ34vX2NvZGUvY29sb3JhZG8tZG93L2RhdGFzZXRzL0VsayBEcmF3aW5nIFN1bW1hcmllcy5SJywgZWNobz1GKQpgYGAKClRhYmxlIG9mIHRoZSBkYXRhCmBgYHtyfQpoZWFkKENPRWxrRHJhd0FsbCkKYGBgCgpzb3VyY2UgZ2VvZGF0YQpgYGB7cn0Kc291cmNlKCd+L19jb2RlL2NvbG9yYWRvLWRvdy9kYXRhc2V0cy9Db2xvcmFkbyBHTVVuaXQgYW5kIFJvYWQgZGF0YS5SJywgZWNobz1GKQpgYGAKClRha2UgYSBwZWFrIGF0IHRoZSBib3VuZGFyeSBkYXRhCmBgYHtyfQpoZWFkKFVuaXRib3VuZGFyaWVzMikKYGBgCgpTZXQgdG8gcHJlZGljdGl2ZSBhbmFseXRpY3MgZGlyZWN0b3J5CmBgYHtyfQpzZXR3ZCgifi9fY29kZS9jb2xvcmFkby1kb3cvcGhhc2UgSUlJIC0gcHJlZGljdGl2ZSBhbmFseXRpY3MiKQpgYGAKCiMjIyBPcmdhbml6ZSBkYXRhCldpbGwgc3RhcnQgYnkgZ3JvdXBpbmcgYWxsIG9mIHRoZSBzZWFzb25zIHRvZ2V0aGVyLCBhbmQgbW9kZWxpbmcgdGhlIG51bWJlciBvZiBodW50ZXJzIHBlciBZZWFyIGFuZCBVbml0CgpHcm91cCBEcmF3IHJlc3VsdHMgZGF0YSBieSBZZWFyIGFuZCBVbml0CmBgYHtyfQpDT0Vsa0RyYXdfVW5pdCA8LSBzdW1tYXJpc2UoZ3JvdXBfYnkoQ09FbGtEcmF3QWxsLFllYXIsVW5pdCxTZWFzb24pLAogICAgICAgICAgICAgICAgICAgICAgIFF1b3RhID0gc3VtKE9yaWdfUXVvdGEsbmEucm0gPSBUKSwKICAgICAgICAgICAgICAgICAgICAgICBEcmF3biA9IHN1bShDaGNzX0RyYXduLG5hLnJtID0gVCkpCmBgYAoKQXBwcm9wcmlhdGUgZmllbGQgY2xhc3NlcyBmb3IgbW9kZWwgdHJhaW5pbmcKYGBge3J9CkNPRWxrRHJhd19Vbml0JFllYXIgPC0gYXMubnVtZXJpYyhDT0Vsa0RyYXdfVW5pdCRZZWFyKQpgYGAKCkdyb3VwIEh1bnRlciBkYXRhIGJ5IFllYXIgYW5kIFVuaXQKYGBge3J9CkNPRWxrSHVudGVyc19Vbml0IDwtIHN1bW1hcmlzZShncm91cF9ieShDT0Vsa1JpZmxlQWxsLFllYXIsVW5pdCxTZWFzb24pLAogICAgICAgICAgICAgICAgICAgICAgICAgIEh1bnRlcnMgPSBzdW0oYyhIdW50ZXJzLkFudGxlcmVkLEh1bnRlcnMuQW50bGVybGVzcyxIdW50ZXJzLkVpdGhlciksbmEucm0gPSBUKSkKCkNPRWxrSHVudGVyc19Vbml0JFllYXIgPC0gYXMubnVtZXJpYyhDT0Vsa0h1bnRlcnNfVW5pdCRZZWFyKQpgYGAKCkpvaW4gaW4gSHVudGVyIGFuZCBEcmF3IGRhdGEgdG9nZXRoZXIKYGBge3J9CkNPRWxrSHVudGVyc19Vbml0IDwtIGxlZnRfam9pbihDT0Vsa0h1bnRlcnNfVW5pdCwgQ09FbGtEcmF3X1VuaXQsIGJ5ID0gYygiWWVhciIsIlVuaXQiLCJTZWFzb24iKSkKYGBgCgpSZXBsYWNlIHRoZSBkcmF3IGRhdGEgdGhhdCBkb24ndCBoYXZlIGVudHJpZXMgd2l0aCAwCmBgYHtyfQpDT0Vsa0h1bnRlcnNfVW5pdCREcmF3bltpcy5uYShDT0Vsa0h1bnRlcnNfVW5pdCREcmF3bildIDwtIDAKQ09FbGtIdW50ZXJzX1VuaXQkUXVvdGFbaXMubmEoQ09FbGtIdW50ZXJzX1VuaXQkUXVvdGEpXSA8LSAwCmBgYAoKU3BsaXQgaW50byB0cmFpbiBhbmQgdGVzdCBzZXRzLiBXaWxsIHVzZSA3NSUgb2YgdGhlIGRhdGEgdG8gdHJhaW4gb24uIAoKYGBge3J9CkNPRWxrSHVudGVyc19Vbml0IDwtIG11dGF0ZShncm91cF9ieShDT0Vsa0h1bnRlcnNfVW5pdCxVbml0KSwKICAgICAgICAgICAgICAgICAgICAgICBudW1lbnRyaWVzID0gbigpKQpDT0Vsa0h1bnRlcnNfVW5pdCA8LSBmaWx0ZXIoQ09FbGtIdW50ZXJzX1VuaXQsIG51bWVudHJpZXMgPj0gMykKQ09FbGtIdW50ZXJzX1VuaXQkVW5pdFllYXJTZWFzb24gPC0gcGFzdGUoQ09FbGtIdW50ZXJzX1VuaXQkVW5pdCwgQ09FbGtIdW50ZXJzX1VuaXQkWWVhcixDT0Vsa0h1bnRlcnNfVW5pdCRTZWFzb24pCgp0cmFpbmRhdGEyIDwtIENPRWxrSHVudGVyc19Vbml0ICU+JSBncm91cF9ieShVbml0KSAlPiUgc2FtcGxlX2ZyYWMoc2l6ZSA9IC43NSwgcmVwbGFjZSA9IEYpCnRlc3RkYXRhMiA8LSBDT0Vsa0h1bnRlcnNfVW5pdFshQ09FbGtIdW50ZXJzX1VuaXQkVW5pdFllYXJTZWFzb24gJWluJSB0cmFpbmRhdGEyJFVuaXRZZWFyU2Vhc29uLF0KCkNPRWxrSHVudGVyc19Vbml0IDwtIHNlbGVjdChDT0Vsa0h1bnRlcnNfVW5pdCwgLVVuaXRZZWFyU2Vhc29uLCAtbnVtZW50cmllcykKCnRyYWluZGF0YTIgPC0gc2VsZWN0KHRyYWluZGF0YTIsIC1Vbml0WWVhclNlYXNvbiwgLW51bWVudHJpZXMpCnRlc3RkYXRhMiA8LSBzZWxlY3QodGVzdGRhdGEyLCAtVW5pdFllYXJTZWFzb24sIC1udW1lbnRyaWVzKQpgYGAKClNhdmUgb2ZmIGZvciBpbXBvcnRpbmcgaW50byBBenVyZU1MCmBgYHtyfQp3cml0ZS5jc3YoQ09FbGtIdW50ZXJzX1VuaXQsZmlsZSA9ICJ+L19jb2RlL2NvbG9yYWRvLWRvdy9kYXRhc2V0cy9DT0Vsa0h1bnRlcnNfVW5pdC5jc3YiLHJvdy5uYW1lcyA9IEYpCmBgYAojIyMgRGF0YSBWaXN1YWxpemF0aW9uCm5vdGljZSB0aGF0IHRoZSBudW1iZXIgb2YgaHVudGVycyBkYXRhIGlzIHNrZXdlZC4KYGBge3IgZmlnLndpZHRoPTEwfQpnZ3Bsb3QoQ09FbGtIdW50ZXJzX1VuaXQsIGFlcyhIdW50ZXJzKSkgKyAKICBnZW9tX2RlbnNpdHkoKSArCiAgeGxhYigiSHVudGVycyBpbiBVbml0IikgKwogIHlsYWIoIk51bWJlciBvZiBVbml0cyIpICsKICB0aGVtZShheGlzLnRleHQueSA9IGVsZW1lbnRfYmxhbmsoKSkgKwogIGxhYnModGl0bGU9IkRpc3RyaWJ1dGlvbiBvZiBIdW50ZXJzIGluIGVhY2ggVW5pdCIsIHN1YnRpdGxlPSIyMDA2LTIwMTciLCBjYXB0aW9uPSJzb3VyY2U6IGNwdy5zdGF0ZS5jby51cyIpCgpgYGAKCgpBIGdlbmVyYWwgcnVsZSBvZiB0aHVtYiB0byBjb25zaWRlciBpcyB0aGF0IHNrZXdlZCBkYXRhIHdob3NlIHJhdGlvIG9mIHRoZSBoaWdoZXN0IHZhbHVlIHRvIHRoZSAKbG93ZXN0IHZhbHVlIGlzIGdyZWF0ZXIgdGhhbiAyMCBoYXZlIHNpZ25pZmljYW50IHNrZXduZXNzLiBBbHNvLCB0aGUgc2tld25lc3Mgc3RhdGlzdGljIGNhbiBiZSAKdXNlZCBhcyBhIGRpYWdub3N0aWMuIElmIHRoZSBwcmVkaWN0b3IgZGlzdHJpYnV0aW9uIGlzIHJvdWdobHkgc3ltbWV0cmljLCB0aGUgc2tld25lc3MgdmFsdWVzIAp3aWxsIGJlIGNsb3NlIHRvIHplcm8uIEFzIHRoZSBkaXN0cmlidXRpb24gYmVjb21lcyBtb3JlIHJpZ2h0IHNrZXdlZCwgdGhlIHNrZXduZXNzIHN0YXRpc3RpYyAKYmVjb21lcyBsYXJnZXIuIFNpbWlsYXJseSwgYXMgdGhlIGRpc3RyaWJ1dGlvbiBiZWNvbWVzIG1vcmUgbGVmdCBza2V3ZWQsIHRoZSB2YWx1ZSBiZWNvbWVzIG5lZ2F0aXZlLgpSZXBsYWNpbmcgdGhlIGRhdGEgd2l0aCB0aGUgbG9nLCBzcXVhcmUgcm9vdCwgb3IgaW52ZXJzZSBtYXkgaGVscCB0byByZW1vdmUgdGhlIHNrZXcuCgpFeGFtcGxlIG9mIGhvdyBCb3hDb3ggY2FuIHJlZGlzdHJpYnV0ZSB0aGUgZGF0YQpgYGB7cn0KcHJlUHJvY1ZhbHVlczIgPC0gcHJlUHJvY2Vzcyhhcy5kYXRhLmZyYW1lKHRyYWluZGF0YTIpLCBtZXRob2QgPSAiQm94Q294IikKdHJhaW5CQyA8LSBwcmVkaWN0KHByZVByb2NWYWx1ZXMyLCBhcy5kYXRhLmZyYW1lKHRyYWluZGF0YTIpKQpgYGAKCmBgYHtyIGZpZy53aWR0aD0xMH0KZ2dwbG90KHRyYWluQkMsIGFlcyhIdW50ZXJzKSkgKyAKICBnZW9tX2RlbnNpdHkoKSArCiAgeGxhYigiQm94Q294IEh1bnRlcnMgaW4gVW5pdCIpICsKICB5bGFiKCJOdW1iZXIgb2YgVW5pdHMiKSArCiAgdGhlbWUoYXhpcy50ZXh0LnkgPSBlbGVtZW50X2JsYW5rKCkpICsKICBsYWJzKHRpdGxlPSJCb3hDb3ggRGlzdHJpYnV0aW9uIG9mIEh1bnRlcnMgaW4gZWFjaCBVbml0Iiwgc3VidGl0bGU9IjIwMDYtMjAxNyIsIGNhcHRpb249InNvdXJjZTogY3B3LnN0YXRlLmNvLnVzIikKYGBgCmNhcmV0IGhhcyBhIHByZXByb2NjZXNzIGZ1bmN0aW9uIGZvciBjb3JyZWN0aW5nIGZvciBza2V3bmVzcyAnQm94Q294Jywgd2Ugd2lsbCBuZWVkIHRvIGJlIHN1cmUgdG8KbG9vayBhdCB1c2luZyB0aGlzIGZ1bmN0aW9uIGluIHRoZSB0cmFpbmluZyBtb2RlbHMuCgoqKioKIyMgTW9kZWwgQnVpbGRpbmcKCiMjIyBNb2RlbCBUcmFpbmluZyBNZXRob2RzCkxvb3AgdGhyb3VnaCBwb3NzaWJsZSBtZXRob2RzLCB1dGlsaXppbmcgdGhlIHF1aWNrZXIgJ2FkYXB0aXZlX2N2JyBwYXJhbWV0ZXIgc2VhcmNoIGZyb20gY2FyZXQuCkNvbnNpZGVyIHNjcmlwdGluZyB0aGlzIGludG8gQXp1cmVNTCB0byBtYWtlIGl0IHJ1biBtdWNoIGZhc3RlciwgdGhvdWdoIHRoZXJlIGlzIG1vcmUgc2V0dXAgYW5kIGVycm9ycyB0byAKY29udHJvbCBmb3IKCmBgYHtyfQpxdWlja21ldGhvZHMgPC0gYygibG0iLCdzdm1MaW5lYXInLCJzdm1SYWRpYWwiLCJrbm4iLCJjdWJpc3QiLCJra25uIiwiZ2xtLm5iIikKCnN0ZXAxX2FsbF9Vbml0IDwtIE5VTEwKZm9yIChpbWV0aG9kIGluIHF1aWNrbWV0aG9kcykgewogIHN0ZXAxX1VuaXQgPC0gTlVMTAogIHN0YXJ0IDwtIG5vdygpCiAgCiAgIyBpZiAoaW1ldGhvZCA9PSAibG0iKSB7CiAgIyAgIGNvbnRyb2xtZXRob2QgPC0gInJlcGVhdGVkY3YiCiAgIyB9IGVsc2Uge2NvbnRyb2xtZXRob2QgPC0gImFkYXB0aXZlX2N2In0KICBjb250cm9sbWV0aG9kIDwtICJyZXBlYXRlZGN2IgogIGZpdENvbnRyb2wgPC0gdHJhaW5Db250cm9sKAogICAgbWV0aG9kID0gY29udHJvbG1ldGhvZCwKICAgICMgc2VhcmNoID0gJ3JhbmRvbScsCiAgICBudW1iZXIgPSA0LAogICAgcmVwZWF0cyA9IDQsCiAgICBhbGxvd1BhcmFsbGVsID0gVFJVRSwKICAgIHN1bW1hcnlGdW5jdGlvbiA9IGRlZmF1bHRTdW1tYXJ5KQogIAogIHJlZ2lzdGVyRG9TRVEoKQogIHJlZ2lzdGVyRG9NQyhjb3JlcyA9IDYpCiAgCiAgSHVudGVyc01vZGVsXzFfVW5pdCA9IHRyYWluKEh1bnRlcnMgfiAuLCBkYXRhID0gdHJhaW5kYXRhMiwKICAgICAgICAgICAgICAgICAgICAgICAgIG1ldGhvZCA9IGltZXRob2QsCiAgICAgICAgICAgICAgICAgICAgICAgICB0dW5lTGVuZ3RoID0gMTUsCiAgICAgICAgICAgICAgICAgICAgICAgICB0ckNvbnRyb2wgPSBmaXRDb250cm9sKQogIAogIEh1bnRlcnNNb2RlbF8xX1VuaXQKICAKICAjIG1lYXN1cmUgcGVyZm9ybWFuY2UKICBwcmVkaWN0ZGF0YSA8LSBwcmVkaWN0KEh1bnRlcnNNb2RlbF8xX1VuaXQsIHRlc3RkYXRhMikKICAKICBzdGVwMV9Vbml0JG1ldGhvZCA8LSBpbWV0aG9kCiAgc3RlcDFfVW5pdCRSTVNFIDwtIHBvc3RSZXNhbXBsZShwcmVkID0gcHJlZGljdGRhdGEsIG9icyA9IHRlc3RkYXRhMiRIdW50ZXJzKVsxXQogIHN0ZXAxX1VuaXQkZHVyYXRpb24gPC0gbm93KCkgLSBzdGFydAogIHN0ZXAxX1VuaXQgPC0gYXMuZGF0YS5mcmFtZShzdGVwMV9Vbml0KQogIHN0ZXAxX2FsbF9Vbml0IDwtIHJiaW5kKHN0ZXAxX2FsbF9Vbml0LHN0ZXAxX1VuaXQpCn0KYGBgClZpZXcgUmVzdWx0cywgYW5kIGNvbXBhcmUgdG8gcHJldmlvdXMgZmlyc3QgbW9kZWxzIHRoYXQgZGlkIG5vdCBleHBhbmQgdG8gU2Vhc29ucwpgYGB7cn0Kc3RlcDFfYWxsCnN0ZXAxX2FsbF9Vbml0CmBgYApUaGUgcGVyZm9ybWFuY2UgUk1TRSBtZXRyaWMgaXMgY2VydGFpbmx5IGltcHJvdmVkIHdoZW4gaW5jbHVkaW5nIHRoZSBTZWFzb25hbCBncm91cGluZy4KTGV0cyB0YWtlIHRoZSBiZXN0IG1ldGhvZCwgYW5kIHNlZSBpZiBpdCBpcyB2aXN1YWxseSByZWFzb25hYmxlIHdoaWxlIGFsc28gY2hhcnRpbmcgd2l0aG91dCBTZWFzb25zLgoKIyMjIFByZWRpY3Rpb25zIHVzaW5nIGJlc3QgU2Vhc29uIG1vZGVsCkJ1aWxkIG1vZGVsCmBgYHtyfQpjb250cm9sbWV0aG9kIDwtICJyZXBlYXRlZGN2IgogIGZpdENvbnRyb2wgPC0gdHJhaW5Db250cm9sKAogICAgbWV0aG9kID0gY29udHJvbG1ldGhvZCwKICAgICMgc2VhcmNoID0gJ3JhbmRvbScsCiAgICBudW1iZXIgPSA0LAogICAgcmVwZWF0cyA9IDQsCiAgICBhbGxvd1BhcmFsbGVsID0gVFJVRSwKICAgIHN1bW1hcnlGdW5jdGlvbiA9IGRlZmF1bHRTdW1tYXJ5KQogIApyZWdpc3RlckRvU0VRKCkKcmVnaXN0ZXJEb01DKGNvcmVzID0gNikKICAKSHVudGVyc01vZGVsXzFfVW5pdCA9IHRyYWluKEh1bnRlcnMgfiAuLCBkYXRhID0gQ09FbGtIdW50ZXJzX1VuaXQsCiAgICAgICAgICAgICAgICAgICAgICAgICBtZXRob2QgPSAia2tubiIsCiAgICAgICAgICAgICAgICAgICAgICAgICAjIHByZVByb2MgPSBjKCJjZW50ZXIiLCJzY2FsZSIpLCAKICAgICAgICAgICAgICAgICAgICAgICAgIHR1bmVMZW5ndGggPSAxNSwKICAgICAgICAgICAgICAgICAgICAgICAgIHRyQ29udHJvbCA9IGZpdENvbnRyb2wpCiAgCkh1bnRlcnNNb2RlbF8xX1VuaXQKYGBgClByZWRpY3QgSHVudGVyIGZvciBuZXh0IHllYXIsIDIwMTgKYGBge3J9CiMgR2V0IGxpc3Qgb2YgVW5pdHMgYW5kIFNlYXNvbnMgdGhhdCB3aWxsIGhhdmUgZGF0YQpDT0Vsa0h1bnRlcnMyMDE4X1VuaXQgPC0gQ09FbGtIdW50ZXJzX1VuaXQKQ09FbGtIdW50ZXJzMjAxOF9Vbml0JFVuaXRfU2Vhc29uIDwtIHBhc3RlKENPRWxrSHVudGVyczIwMThfVW5pdCRVbml0LENPRWxrSHVudGVyczIwMThfVW5pdCRTZWFzb24pCkNPRWxrSHVudGVyczIwMThfVW5pdCA8LSBhcy5kYXRhLmZyYW1lKHVuaXF1ZShDT0Vsa0h1bnRlcnMyMDE4X1VuaXQkVW5pdF9TZWFzb24pKQpjb2xuYW1lcyhDT0Vsa0h1bnRlcnMyMDE4X1VuaXQpIDwtICJVbml0X1NlYXNvbiIKIyBGaWxsIGluIG1pc3NpbmcgVW5pdHMgYW5kIFNlYXNvbnMgcGVyIHVuaXF1ZSBVbml0X1NlYXNvbnMKQ09FbGtIdW50ZXJzMjAxOF9Vbml0JFVuaXQgPC0gc3RyX2V4dHJhY3QoQ09FbGtIdW50ZXJzMjAxOF9Vbml0JFVuaXRfU2Vhc29uLCJbOmFsbnVtOl0rKD89WzpibGFuazpdKSIpCkNPRWxrSHVudGVyczIwMThfVW5pdCRTZWFzb24gPC0gc3RyX2V4dHJhY3QoQ09FbGtIdW50ZXJzMjAxOF9Vbml0JFVuaXRfU2Vhc29uLCIoPzw9WzpibGFuazpdKVs6YWxudW06XSsiKQpDT0Vsa0h1bnRlcnMyMDE4X1VuaXQgPC0gc2VsZWN0KENPRWxrSHVudGVyczIwMThfVW5pdCwgLVVuaXRfU2Vhc29uKQpDT0Vsa0h1bnRlcnMyMDE4X1VuaXQkWWVhciA8LSAyMDE4CiMgRHJhdyBkYXRhIGZvciAyMDE4CkNPRWxrRHJhd19Vbml0MjAxOCA8LSBmaWx0ZXIoQ09FbGtEcmF3X1VuaXQsWWVhcj09MjAxOCkKCiMgQSBsZWZ0IGpvaW4gd2lsbCBhdXRvZmlsbCBtaXNzaW5nIGRyYXcgZGF0YSB3aXRoIE5BcywgYnV0IHdpbGwgcmV0YWluIHRoZSBmdWxsIGxpc3Qgb2YgVW5pdCBTZWFzb25zCkNPRWxrSHVudGVyczIwMThfVW5pdCA8LSBsZWZ0X2pvaW4oQ09FbGtIdW50ZXJzMjAxOF9Vbml0LENPRWxrRHJhd19Vbml0MjAxOCkKCiMgUmVwbGFjZSB0aGUgZHJhdyBkYXRhIHRoYXQgZG9uJ3QgaGF2ZSBlbnRyaWVzIHdpdGggMApDT0Vsa0h1bnRlcnMyMDE4X1VuaXQkRHJhd25baXMubmEoQ09FbGtIdW50ZXJzMjAxOF9Vbml0JERyYXduKV0gPC0gMApDT0Vsa0h1bnRlcnMyMDE4X1VuaXQkUXVvdGFbaXMubmEoQ09FbGtIdW50ZXJzMjAxOF9Vbml0JFF1b3RhKV0gPC0gMAoKIyBPbmx5IHVzZSB0aGUgZmllbGRzIHRoYXQgd2VyZSBpbmNsdWRlZCBpbiB0aGUgbW9kZWwKQ09FbGtIdW50ZXJzMjAxOF9Vbml0IDwtIENPRWxrSHVudGVyczIwMThfVW5pdFssIGNvbG5hbWVzKENPRWxrSHVudGVyczIwMThfVW5pdCkgJWluJSBjKCJVbml0IiwiU2Vhc29uIixIdW50ZXJzTW9kZWxfMV9Vbml0JGNvZWZuYW1lcyldCiMgVXNlIHRyYWluZWQgbW9kZWwgdG8gcHJlZGljdCBIdW50ZXJzCkNPRWxrSHVudGVyczIwMThfVW5pdCRIdW50ZXJzIDwtIHJvdW5kKHByZWRpY3QoSHVudGVyc01vZGVsXzFfVW5pdCwgQ09FbGtIdW50ZXJzMjAxOF9Vbml0KSkKCkNPRWxrSHVudGVyczIwMThfVW5pdCRIdW50ZXJzW0NPRWxrSHVudGVyczIwMThfVW5pdCRIdW50ZXJzPDBdIDwtIDAKYGBgCgpMYWJlbCBhbmQgSm9pbiBtb2RlbHMgdG9nZXRoZXIgZm9yIGNvbXBhcmlzb25zCmBgYHtyfQojIExvYWQgZmlyc3QgbW9kZWwgd2l0aG91dCBTZWFzb25zCmxvYWQoIn4vX2NvZGUvY29sb3JhZG8tZG93L2RhdGFzZXRzL0NPRWxrSHVudGVyczIwMTguUkRhdGEiKQpIdW50ZXJzY29tcGFyZSA8LSByYmluZC5maWxsKENPRWxrSHVudGVycyxDT0Vsa0h1bnRlcnMyMDE4KQpIdW50ZXJzY29tcGFyZSRtb2RlbGRhdGEgPC0gIldpdGhvdXQgU2Vhc29ucyIKCkh1bnRlcnNjb21wYXJlX1NlYXNvbiA8LSByYmluZC5maWxsKENPRWxrSHVudGVyc19Vbml0LENPRWxrSHVudGVyczIwMThfVW5pdCkKSHVudGVyc2NvbXBhcmVfU2Vhc29uIDwtIHN1bW1hcmlzZShncm91cF9ieShIdW50ZXJzY29tcGFyZV9TZWFzb24sWWVhcixVbml0KSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBIdW50ZXJzID0gc3VtKEh1bnRlcnMpKQpIdW50ZXJzY29tcGFyZV9TZWFzb24kbW9kZWxkYXRhIDwtICJTZWFzb25zIgoKSHVudGVyc2NvbXBhcmUgPC0gcmJpbmQuZmlsbChIdW50ZXJzY29tcGFyZSxIdW50ZXJzY29tcGFyZV9TZWFzb24pCgpgYGAKYGBge3J9CiMgR3JvdXAgVW5pdHMKSHVudGVyc2NvbXBhcmVTdGF0ZXdpZGUgPC0gc3VtbWFyaXNlKGdyb3VwX2J5KEh1bnRlcnNjb21wYXJlLFllYXIsbW9kZWxkYXRhKSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBIdW50ZXJzID0gc3VtKEh1bnRlcnMpKQpgYGAKCmBgYHtyIGZpZy53aWR0aD0xMH0KZ2dwbG90KEh1bnRlcnNjb21wYXJlU3RhdGV3aWRlLCBhZXMoWWVhcixIdW50ZXJzLGdyb3VwPW1vZGVsZGF0YSxmaWxsPW1vZGVsZGF0YSkpICsKICBnZW9tX2Jhcihwb3NpdGlvbj0iZG9kZ2UiLHN0YXQ9ImlkZW50aXR5IikgKwogIGNvb3JkX2NhcnRlc2lhbih5bGltID0gYygxMzAwMDAsMTU1MDAwKSkgKwogIHNjYWxlX2ZpbGxfaGMoKSArCiAgbGFicyh0aXRsZT0iU3RhdGV3aWRlIEVsayBIdW50ZXJzIiwgY2FwdGlvbj0ic291cmNlOiBjcHcuc3RhdGUuY28udXMiKQpgYGAKCgojIyMjIEh1bnRlcnMgU3RhdGV3aWRlIGJ5IFNlYXNvbiBhbmQgWWVhcgpgYGB7ciBmaWcud2lkdGg9MTB9Ckh1bnRlcnNfU2Vhc29uIDwtIHJiaW5kLmZpbGwoQ09FbGtIdW50ZXJzX1VuaXQsQ09FbGtIdW50ZXJzMjAxOF9Vbml0KQpnZ3Bsb3QoSHVudGVyc19TZWFzb24sIGFlcyhZZWFyLEh1bnRlcnMsZ3JvdXA9U2Vhc29uLGZpbGw9U2Vhc29uKSkgKwogIGdlb21fYmFyKHBvc2l0aW9uPSJkb2RnZSIsc3RhdD0iaWRlbnRpdHkiKSArCiAgIyBjb29yZF9jYXJ0ZXNpYW4oeWxpbSA9IGMoMTMwMDAwLDE1NTAwMCkpICsKICBzY2FsZV9maWxsX2hjKCkgKwogIGxhYnModGl0bGU9IlN0YXRld2lkZSBFbGsgSHVudGVycyIsIGNhcHRpb249InNvdXJjZTogY3B3LnN0YXRlLmNvLnVzIikKYGBgCgojIyMjIEh1bnRlcnMgLi4uLiBvdGhlciBjaGFydHM/CgoKIyMgS2VlcCBnb2luZyBieSBjcmVhdGluZyBtb2RlbHMgZm9yIGh1bnRlcnMgcGVyIHllYXIsIHVuaXQgYW5kIHNlYXNvbj8KCgpgYGB7cn0KdG9wX3R3b19tb2RlbHMgPC0gdG9wX24oc3RlcDFfYWxsLDIsLVJNU0UpJG1ldGhvZApgYGAKIyMjIE1vcmUgTW9kZWwgVHJhaW5pbmcgTWV0aG9kcwoKVGFrZSB0aGUgdG9wIHR3byBhbmQgZGV0ZXJtaW5lIHNvbWUgYWRkaXRvbmFsIG1ldGhvZHMgdG8gdHJ5IGJ5IG1heGltaXppbmcgdGhlIEphY2NhcmQKZGlzc2ltaWxhcml0eSBiZXR3ZWVuIHNldHMgb2YgbW9kZWxzCmBgYHtyfQp0YWcgPC0gcmVhZC5jc3YoInRhZ19kYXRhLmNzdiIsIHJvdy5uYW1lcyA9IDEpCnRhZyA8LSBhcy5tYXRyaXgodGFnKQpgYGAKClNlbGVjdCBvbmx5IG1vZGVscyBmb3IgcmVncmVzc2lvbgpgYGB7cn0KcmVnTW9kZWxzIDwtIHRhZ1t0YWdbLCJSZWdyZXNzaW9uIl0gPT0gMSxdCgphbGwgPC0gMTpucm93KHJlZ01vZGVscykKZGlzc2ltaWxhcm1ldGhvZHNfYWxsIDwtIE5VTEwKZm9yIChpdG9wdHdvIGluIDE6MikgewogICMjIFNlZWQgdGhlIGFuYWx5c2lzIHdpdGggdGhlIG1vZGVsIG9mIGludGVyZXN0CiAgc3RhcnQgPC0gZ3JlcCh0b3BfdHdvX21vZGVsc1tpdG9wdHdvXSwgcm93bmFtZXMocmVnTW9kZWxzKSwgZml4ZWQgPSBUUlVFKQogIHBvb2wgPC0gYWxsW2FsbCAhPSBzdGFydF0KICAKICAjIyBTZWxlY3QgNCBtb2RlbCBtb2RlbHMgYnkgbWF4aW1pemluZyB0aGUgSmFjY2FyZAogICMjIGRpc3NpbWlsYXJpdHkgYmV0d2VlbiBzZXRzIG9mIG1vZGVscwogIG5leHRNb2RzIDwtIG1heERpc3NpbShyZWdNb2RlbHNbc3RhcnQsLGRyb3AgPSBGQUxTRV0sIAogICAgICAgICAgICAgICAgICAgICAgICByZWdNb2RlbHNbcG9vbCwgXSwgCiAgICAgICAgICAgICAgICAgICAgICAgIG1ldGhvZCA9ICJKYWNjYXJkIiwKICAgICAgICAgICAgICAgICAgICAgICAgbiA9IDQpCiAgCiAgcm93bmFtZXMocmVnTW9kZWxzKVtjKG5leHRNb2RzKV0KICAKICBkaXNzaW1pbGFybWV0aG9kcyA8LSByb3duYW1lcyhyZWdNb2RlbHMpW25leHRNb2RzXQogIGRpc3NpbWlsYXJtZXRob2RzIDwtIHN0cl9leHRyYWN0KHN0cmluZyA9IGRpc3NpbWlsYXJtZXRob2RzLHBhdHRlcm4gPSAiWzphbG51bTpdKyg/PVxcKSkiKQogIGRpc3NpbWlsYXJtZXRob2RzX2FsbCA8LSBjKGRpc3NpbWlsYXJtZXRob2RzX2FsbCxkaXNzaW1pbGFybWV0aG9kcykKfQpgYGAKCk5vdyB3ZSBoYXZlIDggbW9yZSBtZXRob2RzIHRvIHRyeSBpbiB0aGUgc2FtZSBtYW5uZXIKYGBge3J9CmRpc3NpbWlsYXJtZXRob2RzX2FsbCA8LSB1bmlxdWUoZGlzc2ltaWxhcm1ldGhvZHNfYWxsKQpkaXNzaW1pbGFybWV0aG9kc19hbGwKYGBgCmBgYHtyfQpmb3IgKGltZXRob2QgaW4gZGlzc2ltaWxhcm1ldGhvZHNfYWxsKSB7CiAgc3RlcDEgPC0gTlVMTAogIHN0YXJ0X3RpbWVyIDwtIG5vdygpWzFdCiAgCiAgaWYgKGltZXRob2QgPT0gImxtIikgewogICAgY29udHJvbG1ldGhvZCA8LSAicmVwZWF0ZWRjdiIKICB9IGVsc2Uge2NvbnRyb2xtZXRob2QgPC0gImFkYXB0aXZlX2N2In0KICAKICBmaXRDb250cm9sIDwtIHRyYWluQ29udHJvbCgKICAgIG1ldGhvZCA9IGNvbnRyb2xtZXRob2QsCiAgICAjIHNlYXJjaCA9ICdyYW5kb20nLAogICAgbnVtYmVyID0gNCwKICAgIHJlcGVhdHMgPSA0LAogICAgYWxsb3dQYXJhbGxlbCA9IFRSVUUsCiAgICBzdW1tYXJ5RnVuY3Rpb24gPSBkZWZhdWx0U3VtbWFyeSkKICAKICByZWdpc3RlckRvU0VRKCkKICByZWdpc3RlckRvTUMoY29yZXMgPSA2KQogIAogIEh1bnRlcnNNb2RlbF8xID0gdHJhaW4oSHVudGVycyB+IC4sIGRhdGEgPSB0cmFpbmRhdGEsCiAgICAgICAgICAgICAgICAgICAgICAgICBtZXRob2QgPSBpbWV0aG9kLAogICAgICAgICAgICAgICAgICAgICAgICAgcHJlUHJvYyA9IGMoImNlbnRlciIsInNjYWxlIiksIAogICAgICAgICAgICAgICAgICAgICAgICAgdHVuZUxlbmd0aCA9IDE1LAogICAgICAgICAgICAgICAgICAgICAgICAgdHJDb250cm9sID0gZml0Q29udHJvbCkKICAKICBIdW50ZXJzTW9kZWxfMQogIAogICMgbWVhc3VyZSBwZXJmb3JtYW5jZQogIHByZWRpY3RkYXRhIDwtIHByZWRpY3QoSHVudGVyc01vZGVsXzEsIHRlc3RkYXRhKQogIAogIHN0ZXAxJG1ldGhvZCA8LSBpbWV0aG9kCiAgc3RlcDEkUk1TRSA8LSBwb3N0UmVzYW1wbGUocHJlZCA9IHByZWRpY3RkYXRhLCBvYnMgPSB0ZXN0ZGF0YSRIdW50ZXJzKVsxXQogIHN0ZXAxJGR1cmF0aW9uIDwtIG5vdygpWzFdIC0gc3RhcnRfdGltZXJbMV0KICBzdGVwMSA8LSBhcy5kYXRhLmZyYW1lKHN0ZXAxKQogIHN0ZXAxX2FsbCA8LSByYmluZChzdGVwMV9hbGwsc3RlcDEpCn0KYGBgCgpgYGB7cn0Kc3RlcDFfYWxsCmBgYAoKIyMjIFByZXByb2Nlc3Npbmcgb24gVG9wIE1vZGVsaW5nIE1ldGhvZHMKTm93IGxldHMgd29yayBvbiBzb21lIHJlZmluZWQgdHVuaW5nIG9uIHRoZSB0b3AgbWV0aG9kcwpBbnkgdmFsdWFibGUgcHJlcHJvY2Vzc2luZyBzdGVwcz8KYGBge3J9CnByZXByb2Nlc3NmdW5jdGlvbnMgPC0gYygiQm94Q294IiwgIlllb0pvaG5zb24iLCAiZXhwb1RyYW5zIiwgImNlbnRlciIsICJzY2FsZSIsICJyYW5nZSIsICJrbm5JbXB1dGUiLCAiYmFnSW1wdXRlIiwgIm1lZGlhbkltcHV0ZSIsICJwY2EiLCAiaWNhIiwgInNwYXRpYWxTaWduIiwgImNvcnIiLCAienYiLCAibnp2IikKdG9wbWV0aG9kcyA8LSB0b3BfbihzdGVwMV9hbGwsMiwtUk1TRSkkbWV0aG9kCgpmaXRDb250cm9sIDwtIHRyYWluQ29udHJvbCgKICBtZXRob2QgPSAiYWRhcHRpdmVfY3YiLCAjcmVwZWF0ZWRjdiwgCiAgc2VhcmNoID0gJ3JhbmRvbScsCiAgbnVtYmVyID0gMTAsICM0CiAgcmVwZWF0cyA9IDEwLCAjMTAKICAjIGNsYXNzUHJvYnMgPSBUUlVFLAogICMgc2F2ZVByZWQgPSBUUlVFLAogIGFsbG93UGFyYWxsZWwgPSBUUlVFLAogIHN1bW1hcnlGdW5jdGlvbiA9IGRlZmF1bHRTdW1tYXJ5KQoKUFBwZXJmb3JtYW5jZV9hbGwgPC0gTlVMTApQUHBlcmZvcm1hbmNlIDwtIE5VTEwKZm9yIChpbWV0aG9kIGluIHRvcG1ldGhvZHMpIHsKICBmb3IgKGlwcmVwcm9jZXNzIGluIHByZXByb2Nlc3NmdW5jdGlvbnMpIHsKICAgIHJlZ2lzdGVyRG9TRVEoKQogICAgcmVnaXN0ZXJEb01DKGNvcmVzID0gNikKICAgIAogICAgUHJlUHJvY2Vzc01vZGVsID0gdHJhaW4oSHVudGVycyB+IC4sIGRhdGEgPSB0cmFpbmRhdGEsCiAgICAgICAgICAgICAgICAgICAgICAgICBtZXRob2QgPSBpbWV0aG9kLAogICAgICAgICAgICAgICAgICAgICAgICAgcHJlUHJvYyA9IGlwcmVwcm9jZXNzLCAKICAgICAgICAgICAgICAgICAgICAgICAgICN0dW5lTGVuZ3RoID0gMTAsCiAgICAgICAgICAgICAgICAgICAgICAgICAjdHVuZUdyaWQgPSBra25uVHVuZUdyaWQsCiAgICAgICAgICAgICAgICAgICAgICAgICB0ckNvbnRyb2wgPSBmaXRDb250cm9sKQogICAgCiAgICBwcmludChQcmVQcm9jZXNzTW9kZWwpCiAgICAKICAgICMgY2hlY2sgcGVyZm9ybWFuY2UKICAgIHByZWRpY3RkYXRhIDwtIHByZWRpY3QoUHJlUHJvY2Vzc01vZGVsLCB0ZXN0ZGF0YSkKICAgIAogICAgUFBwZXJmb3JtYW5jZSRtZXRob2QgPC0gaW1ldGhvZAogICAgUFBwZXJmb3JtYW5jZSRwcmVwcm9jZXNzIDwtIGlwcmVwcm9jZXNzCiAgICBQUHBlcmZvcm1hbmNlJFJNU0UgPC0gcG9zdFJlc2FtcGxlKHByZWQgPSBwcmVkaWN0ZGF0YSwgb2JzID0gdGVzdGRhdGEkSHVudGVycylbMV0KICAgIFBQcGVyZm9ybWFuY2UgPC0gYXMuZGF0YS5mcmFtZShQUHBlcmZvcm1hbmNlKQogICAgUFBwZXJmb3JtYW5jZV9hbGwgPC0gcmJpbmQoUFBwZXJmb3JtYW5jZV9hbGwsUFBwZXJmb3JtYW5jZSkKICB9Cn0KIyBTb21lIG9mIHRoZSBtb2RlbHMgd2VyZSBsb2FkZWQgaW50byBBenVyZU1MIGFuZCBwcm9jZXNzZWQgdGhlcmUuCiMgT3V0cHV0IGZyb20gQXp1cmVNTAojIFtNb2R1bGVPdXRwdXRdICAgICAgICAgIG1ldGhvZCBwcmVwcm9jZXNzICAgICBSTVNFCiMgW01vZHVsZU91dHB1dF0gUk1TRSAgICAgICBra25uICAgICBCb3hDb3ggMTMwLjc5MzkKIyBbTW9kdWxlT3V0cHV0XSBSTVNFMSAgICAgIGtrbm4gWWVvSm9obnNvbiAxMzAuOTYwMAojIFtNb2R1bGVPdXRwdXRdIFJNU0UyICAgICAga2tubiAgICAgY2VudGVyIDEzMC43MzMxCiMgW01vZHVsZU91dHB1dF0gUk1TRTMgICAgICBra25uICAgICAgc2NhbGUgMTMwLjE4MTgKIyBbTW9kdWxlT3V0cHV0XSBSTVNFNCAgICAgIGtrbm4gICAgICAgIHBjYSAxMzAuMjA3MQojIFtNb2R1bGVPdXRwdXRdIFJNU0U1IHN2bVJhZGlhbCAgICAgQm94Q294IDE1NC4wODk4CiMgW01vZHVsZU91dHB1dF0gUk1TRTYgc3ZtUmFkaWFsIFllb0pvaG5zb24gMTY5Ljk4MTYKIyBbTW9kdWxlT3V0cHV0XSBSTVNFNyBzdm1SYWRpYWwgICAgIGNlbnRlciAxNTQuMTg5MQojIFtNb2R1bGVPdXRwdXRdIFJNU0U4IHN2bVJhZGlhbCAgICAgIHNjYWxlIDE1NC4xMDAwCiMgW01vZHVsZU91dHB1dF0gUk1TRTkgc3ZtUmFkaWFsICAgICAgICBwY2EgMTY0LjA4ODEKIyBzdm1SYWRpYWwgYW5kIGtrbm4gZG9uJ3QgcGVyZm9ybSBiZXR0ZXIgd2l0aCBhbnkgb2YgdGhlIHByZXByb2Nlc3NpbmcgZnVuY3Rpb25zIGluIHBsYWNlCmBgYApgYGB7cn0KUFBwZXJmb3JtYW5jZV9hbGwKYGBgCgojIyMgTW9kZWwgUHJlZGljdG9ycwpOb3cgd2UgY2FuIHJldmlldyB0aGUgcHJlZGljdG9ycywgdGhlcmUgYXJlIG9ubHkgYSBmZXcgZmllbGRzIHNvIEkgd2lsbCBtYW51YWxseSB0ZXN0IHBlcmZvcm1hbmNlCndoaWxlIGV4Y2x1ZGluZyBlYWNoIG9mIHRoZW0gdG8gbW9uaXRvciB0aGVpciBpbXBvcnRhbmNlLgpTb21lIG9mIG91ciBmaWVsZHMgYXJlIGluc3RpbmN0aXZlbHkgcmVxdWlyZWQgKFllYXIsIFVuaXQpCmBgYHtyfQpQcmVkaWN0b3JzIDwtIGMoIlF1b3RhIiwiRHJhd24iKQpQcmVkaWN0b3JwZXJmb3JtYW5jZV9hbGwgPC0gTlVMTApQcmVkaWN0b3JwZXJmb3JtYW5jZSA8LSBOVUxMCmZvciAoaW1ldGhvZCBpbiB0b3BtZXRob2RzKSB7CiAgZm9yIChpcHJlZGljdG9yIGluIFByZWRpY3RvcnMpIHsKICAgIHJlZ2lzdGVyRG9TRVEoKQogICAgcmVnaXN0ZXJEb01DKGNvcmVzID0gNikKICAgIAogICAgUHJlZGljdG9yTW9kZWwgPSB0cmFpbihIdW50ZXJzIH4gLiwgZGF0YSA9IHNlbGVjdCh0cmFpbmRhdGEsLWlwcmVkaWN0b3IpLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgbWV0aG9kID0gaW1ldGhvZCwKICAgICAgICAgICAgICAgICAgICAgICAgICAgIHR1bmVMZW5ndGggPSAxNSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgIHRyQ29udHJvbCA9IGZpdENvbnRyb2wpCiAgICAKICAgIHByaW50KFByZWRpY3Rvck1vZGVsKQogICAgCiAgICAjIGNoZWNrIHBlcmZvcm1hbmNlCiAgICBwcmVkaWN0ZGF0YSA8LSBwcmVkaWN0KFByZWRpY3Rvck1vZGVsLCB0ZXN0ZGF0YSkKICAgIAogICAgUHJlZGljdG9ycGVyZm9ybWFuY2UkbWV0aG9kIDwtIGltZXRob2QKICAgIFByZWRpY3RvcnBlcmZvcm1hbmNlJG1pc3NpbmdfcHJlZGljdG9yIDwtIGlwcmVkaWN0b3IKICAgIFByZWRpY3RvcnBlcmZvcm1hbmNlJFJNU0UgPC0gcG9zdFJlc2FtcGxlKHByZWQgPSBwcmVkaWN0ZGF0YSwgb2JzID0gdGVzdGRhdGEkSHVudGVycylbMV0KICAgIFByZWRpY3RvcnBlcmZvcm1hbmNlIDwtIGFzLmRhdGEuZnJhbWUoUHJlZGljdG9ycGVyZm9ybWFuY2UpCiAgICBQcmVkaWN0b3JwZXJmb3JtYW5jZV9hbGwgPC0gcmJpbmQoUHJlZGljdG9ycGVyZm9ybWFuY2VfYWxsLFByZWRpY3RvcnBlcmZvcm1hbmNlKQogIH0KfQpgYGAKCmBgYHtyfQpQcmVkaWN0b3JwZXJmb3JtYW5jZV9hbGwKYGBgCgoKc3ZNUmFkaWFsIHdpbGwgcGVyZm9ybSBiZXR0ZXIgd2l0aCBhbGwgb2YgdGhlIHByZWRpY3RvcnMsIHdoaWxlIGtrbm4gcGVyZm9ybXMKYmV0dGVyIHdpdGggb25seSBVbml0IGFuZCBZZWFyIGZpZWxkcwoKVXNlIGFib3ZlIGluZm9ybWF0aW9uIHRvIHRlc3Qgb3V0IHZhcmlvdXMgY29tYmluYXRpb25zIG9mIHByZXByb2Nlc3NpbmcgYW5kIHByZWRpY3RvciBzZXRzCgojIyMjIyBra25uCmtrbm4gd2l0aG91dCBRdW90YSBhbmQgRHJhd24KYGBge3J9CmZpdENvbnRyb2wgPC0gdHJhaW5Db250cm9sKAogIG1ldGhvZCA9ICJhZGFwdGl2ZV9jdiIsICNyZXBlYXRlZGN2LCAKICBzZWFyY2ggPSAncmFuZG9tJywKICBudW1iZXIgPSAxMCwgIzQKICByZXBlYXRzID0gMTAsICMxMAogICMgY2xhc3NQcm9icyA9IFRSVUUsCiAgIyBzYXZlUHJlZCA9IFRSVUUsCiAgYWxsb3dQYXJhbGxlbCA9IFRSVUUsCiAgc3VtbWFyeUZ1bmN0aW9uID0gZGVmYXVsdFN1bW1hcnkpCgpyZWdpc3RlckRvU0VRKCkKcmVnaXN0ZXJEb01DKGNvcmVzID0gNikKCmtrbm5Nb2RlbCA9IHRyYWluKEh1bnRlcnMgfiAuLCBkYXRhID0gc2VsZWN0KENPRWxrSHVudGVycywtUXVvdGEsIC1EcmF3biksCiAgICAgICAgICAgICAgICAgIG1ldGhvZCA9ICJra25uIiwKICAgICAgICAgICAgICAgICAgdHVuZUxlbmd0aCA9IDc1LAogICAgICAgICAgICAgICAgICB0ckNvbnRyb2wgPSBmaXRDb250cm9sKQoKYGBgCmBgYHtyfQpra25uTW9kZWwKYGBgCgpCZXN0IFJNU0UKYGBge3J9CiMgbm90IHN1cmUgd2h5IGNhcmV0IGlzIHNlbGVjdGluZyBwYXJhbWV0ZXJzIHdpdGggaGlnaGVyIFJNU0UsIGxldHMgc2VsZWN0IG1hbnVhbGx5ClJTTUVra25uIDwtIGZpbHRlcihra25uTW9kZWwkcmVzdWx0cywgUk1TRSA9PSBtaW4oUk1TRSkpClJTTUVra25uJGtlcm5lbCA8LSBhcy5jaGFyYWN0ZXIoUlNNRWtrbm4ka2VybmVsKQpSU01Fa2tubgpgYGAKCiMjIyBNb2RlbCBUdW5pbmcKcnVuIGFnYWluIHdpdGggYSB0dW5lIGdyaWQKYGBge3J9Cmtrbm5UdW5lR3JpZCA8LSBkYXRhLmZyYW1lKGttYXggPSBjKFJTTUVra25uJGttYXgsUlNNRWtrbm4ka21heCxSU01Fa2tubiRrbWF4LFJTTUVra25uJGttYXgsUlNNRWtrbm4ka21heCksCiAgICAgICAgICAgICAgICAgICAgICAgICAgIGRpc3RhbmNlID0gYyhSU01Fa2tubiRkaXN0YW5jZSouNyxSU01Fa2tubiRkaXN0YW5jZSouOSxSU01Fa2tubiRkaXN0YW5jZSxSU01Fa2tubiRkaXN0YW5jZSoxLjEsUlNNRWtrbm4kZGlzdGFuY2UqMS4zKSwKICAgICAgICAgICAgICAgICAgICAgICAgICAga2VybmVsID0gYyhSU01Fa2tubiRrZXJuZWwsUlNNRWtrbm4ka2VybmVsLFJTTUVra25uJGtlcm5lbCxSU01Fa2tubiRrZXJuZWwsUlNNRWtrbm4ka2VybmVsKSkKCmZpdENvbnRyb2wgPC0gdHJhaW5Db250cm9sKAogIG1ldGhvZCA9ICJyZXBlYXRlZGN2IiwgI3JlcGVhdGVkY3YsIAogIG51bWJlciA9IDEwLCAjNAogIHJlcGVhdHMgPSAxMCwgIzEwCiAgYWxsb3dQYXJhbGxlbCA9IFRSVUUsCiAgc3VtbWFyeUZ1bmN0aW9uID0gZGVmYXVsdFN1bW1hcnkpCgpyZWdpc3RlckRvU0VRKCkKcmVnaXN0ZXJEb01DKGNvcmVzID0gNikKCmtrbm5HcmlkTW9kZWwgPSB0cmFpbihIdW50ZXJzIH4gLiwgZGF0YSA9IHNlbGVjdChDT0Vsa0h1bnRlcnMsLVF1b3RhLCAtRHJhd24pLAogICAgICAgICAgICAgICAgICBtZXRob2QgPSAia2tubiIsCiAgICAgICAgICAgICAgICAgIHR1bmVHcmlkID0ga2tublR1bmVHcmlkLAogICAgICAgICAgICAgICAgICB0ckNvbnRyb2wgPSBmaXRDb250cm9sKQpgYGAKYGBge3J9Cmtrbm5HcmlkTW9kZWwKYGBgCgoKQmVzdCBSTVNFCmBgYHtyfQpSU01Fa2tubiA8LSBmaWx0ZXIoa2tubkdyaWRNb2RlbCRyZXN1bHRzLCBSTVNFID09IG1pbihSTVNFKSkKUlNNRWtrbm4ka2VybmVsIDwtIGFzLmNoYXJhY3RlcihSU01Fa2tubiRrZXJuZWwpCmBgYAoKcnVuIGFnYWluIHdpdGggYSB0dW5lIGdyaWQKYGBge3J9Cmtrbm5UdW5lR3JpZDIgPC0gZGF0YS5mcmFtZShrbWF4ID0gYyhSU01Fa2tubiRrbWF4Ki43LFJTTUVra25uJGttYXgqLjksUlNNRWtrbm4ka21heCxSU01Fa2tubiRrbWF4KjEuMSxSU01Fa2tubiRrbWF4KjEuMyksCiAgICAgICAgICAgICAgICAgICAgICAgICAgIGRpc3RhbmNlID0gYyhSU01Fa2tubiRkaXN0YW5jZSxSU01Fa2tubiRkaXN0YW5jZSxSU01Fa2tubiRkaXN0YW5jZSxSU01Fa2tubiRkaXN0YW5jZSxSU01Fa2tubiRkaXN0YW5jZSksCiAgICAgICAgICAgICAgICAgICAgICAgICAgIGtlcm5lbCA9IGMoUlNNRWtrbm4ka2VybmVsLFJTTUVra25uJGtlcm5lbCxSU01Fa2tubiRrZXJuZWwsUlNNRWtrbm4ka2VybmVsLFJTTUVra25uJGtlcm5lbCkpCgpyZWdpc3RlckRvU0VRKCkKcmVnaXN0ZXJEb01DKGNvcmVzID0gNikKCmtrbm5HcmlkTW9kZWwyID0gdHJhaW4oSHVudGVycyB+IC4sIGRhdGEgPSBzZWxlY3QoQ09FbGtIdW50ZXJzLC1RdW90YSwgLURyYXduKSwKICAgICAgICAgICAgICAgICAgICAgIG1ldGhvZCA9ICJra25uIiwKICAgICAgICAgICAgICAgICAgICAgIHR1bmVHcmlkID0ga2tublR1bmVHcmlkMiwKICAgICAgICAgICAgICAgICAgICAgIHRyQ29udHJvbCA9IGZpdENvbnRyb2wpCgpgYGAKCmBgYHtyfQpra25uR3JpZE1vZGVsMgpgYGAKCgpPbmUgbW9yZSB0aW1lIG9uIGZpbmFsIHBhcmFtZXRlciAoa2VybmVsKQpCZXN0IFJNU0UKYGBge3J9ClJTTUVra25uIDwtIGZpbHRlcihra25uR3JpZE1vZGVsMiRyZXN1bHRzLCBSTVNFID09IG1pbihSTVNFKSlbMSxdCmtlcm5lbHMgPC0gbGV2ZWxzKGtrbm5Nb2RlbCRyZXN1bHRzJGtlcm5lbCkKYGBgCgpydW4gYWdhaW4gd2l0aCBhIHR1bmUgZ3JpZApgYGB7cn0Ka2tublR1bmVHcmlkMyA8LSBkYXRhLmZyYW1lKGttYXggPSByZXAoNDY1LjAsOCksCiAgICAgICAgICAgICAgICAgICAgICAgICAgICBkaXN0YW5jZSA9IHJlcCgwLjEzOTU1ODYsOCksCiAgICAgICAgICAgICAgICAgICAgICAgICAgICBrZXJuZWwgPSBrZXJuZWxzKQoKcmVnaXN0ZXJEb1NFUSgpCnJlZ2lzdGVyRG9NQyhjb3JlcyA9IDYpCgpra25uR3JpZE1vZGVsMyA9IHRyYWluKEh1bnRlcnMgfiAuLCBkYXRhID0gc2VsZWN0KENPRWxrSHVudGVycywtUXVvdGEsIC1EcmF3biksCiAgICAgICAgICAgICAgICAgICAgICAgbWV0aG9kID0gImtrbm4iLAogICAgICAgICAgICAgICAgICAgICAgIHR1bmVHcmlkID0ga2tublR1bmVHcmlkMywKICAgICAgICAgICAgICAgICAgICAgICB0ckNvbnRyb2wgPSBmaXRDb250cm9sKQoKYGBgCgpgYGB7cn0Ka2tubkdyaWRNb2RlbDMKYGBgCgpgYGB7cn0KUlNNRWtrbm4gPC0gZmlsdGVyKGtrbm5HcmlkTW9kZWwzJHJlc3VsdHMsIFJNU0UgPT0gbWluKFJNU0UpKQpgYGAKCkJlc3QgUk1TRSBmb3Iga2tubiB0aHVzIGZhcgpgYGB7cn0KUlNNRWtrbm4gPC0gZmlsdGVyKGtrbm5Nb2RlbCRyZXN1bHRzLCBSTVNFID09IG1pbihSTVNFKSkKYGBgCgpXb3JrIHRocnUgc29tZSByZXNhbXBsaW5nIG1ldGhvZHMgd2l0aCBiZXN0IGtrbm4gcGFyYW1zCmBgYHtyfQpra25uVHVuZUdyaWQ0IDwtIGRhdGEuZnJhbWUoa21heCA9IFJTTUVra25uJGttYXgsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICBkaXN0YW5jZSA9IFJTTUVra25uJGRpc3RhbmNlLAogICAgICAgICAgICAgICAgICAgICAgICAgICAga2VybmVsID0gYXMuY2hhcmFjdGVyKFJTTUVra25uJGtlcm5lbCkpCgp0cmFpbm1ldGhvZHMgPC0gYygiYm9vdCIsICJib290NjMyIiwgIm9wdGltaXNtX2Jvb3QiLCAiYm9vdF9hbGwiLCAiY3YiLCAicmVwZWF0ZWRjdiIsICJMT09DViIsICJMR09DViIsICJub25lIikKdHJhaW5tZXRob2RwZXJmb3JtYW5jZV9hbGwgPC0gTlVMTApmb3IgKGl0cmFpbm1ldGhvZCBpbiB0cmFpbm1ldGhvZHMpIHsKICB0cmFpbm1ldGhvZHBlcmZvcm1hbmNlIDwtIE5VTEwKICBmaXRDb250cm9sIDwtIHRyYWluQ29udHJvbCgKICAgIG1ldGhvZCA9IGl0cmFpbm1ldGhvZCwKICAgIG51bWJlciA9IDEwLCAjNAogICAgcmVwZWF0cyA9IDEwLCAjMTAKICAgIGFsbG93UGFyYWxsZWwgPSBUUlVFLAogICAgc3VtbWFyeUZ1bmN0aW9uID0gZGVmYXVsdFN1bW1hcnkpCiAgCiAgcmVnaXN0ZXJEb1NFUSgpCiAgcmVnaXN0ZXJEb01DKGNvcmVzID0gNikKICAKICBra25uVHJhaW5Nb2RlbCA9IHRyYWluKEh1bnRlcnMgfiAuLCBkYXRhID0gc2VsZWN0KENPRWxrSHVudGVycywtUXVvdGEsIC1EcmF3biksCiAgICAgICAgICAgICAgICAgICAgICAgICBtZXRob2QgPSAia2tubiIsCiAgICAgICAgICAgICAgICAgICAgICAgICB0dW5lR3JpZCA9IGtrbm5UdW5lR3JpZDQsCiAgICAgICAgICAgICAgICAgICAgICAgICB0ckNvbnRyb2wgPSBmaXRDb250cm9sKQogIAogIHByaW50KGtrbm5UcmFpbk1vZGVsKQogIHRyYWlubWV0aG9kcGVyZm9ybWFuY2UgPC0gZmlsdGVyKGtrbm5UcmFpbk1vZGVsJHJlc3VsdHMsIFJNU0UgPT0gbWluKFJNU0UpKQogIHRyYWlubWV0aG9kcGVyZm9ybWFuY2UkdHJhaW5tZXRob2QgPC0gaXRyYWlubWV0aG9kCiAgdHJhaW5tZXRob2RwZXJmb3JtYW5jZV9hbGwgPC0gcmJpbmQuZmlsbCh0cmFpbm1ldGhvZHBlcmZvcm1hbmNlX2FsbCx0cmFpbm1ldGhvZHBlcmZvcm1hbmNlKQp9CmBgYApgYGB7cn0KdHJhaW5tZXRob2RwZXJmb3JtYW5jZV9hbGwKYGBgCgoKYGBge3J9CmZpdENvbnRyb2wgPC0gdHJhaW5Db250cm9sKAogIG1ldGhvZCA9ICJvcHRpbWlzbV9ib290IiwKICBudW1iZXIgPSAxMCwgIzQKICBhbGxvd1BhcmFsbGVsID0gVFJVRSwKICBzdW1tYXJ5RnVuY3Rpb24gPSBkZWZhdWx0U3VtbWFyeSkKCmtrbm5GaW5hbFRyYWluTW9kZWwgPSB0cmFpbihIdW50ZXJzIH4gLiwgZGF0YSA9IENPRWxrSHVudGVycywKICAgICAgICAgICAgICAgICAgICAgICBtZXRob2QgPSAia2tubiIsCiAgICAgICAgICAgICAgICAgICAgICAgdHVuZUdyaWQgPSBra25uVHVuZUdyaWQ0LAogICAgICAgICAgICAgICAgICAgICAgIHRyQ29udHJvbCA9IGZpdENvbnRyb2wpCgpgYGAKCnNhdmUgb2ZmIGZvciBmdXR1cmUgbG9hZGluZwpgYGB7cn0Kc2F2ZShra25uRmluYWxUcmFpbk1vZGVsLCBmaWxlID0gIn4vX2NvZGUvY29sb3JhZG8tZG93L2RhdGFzZXRzL2trbm5GaW5hbFRyYWluTW9kZWwuUkRhdGEiKQpgYGAKIyMgTW9kZWwgVGVzdGluZwpiYWNrIHRvIHRyYWluIHZzIHRlc3QgZGF0YSBmb3Igb25lIG1vcmUgcGVyZm9ybWFuY2UgbWVhc3VyZSBhbmQgY2hhcnQuLi4gZXZlbiB0aG91Z2gKZm9yIGZ1dHVyZSBkYXRhIHdlIHdpbGwgdXNlIHRoZSBmaW5hbCB0cmFpbmVkIG1vZGVsCmBgYHtyfQpra25uVHJhaW5Nb2RlbCA9IHRyYWluKEh1bnRlcnMgfiAuLCBkYXRhID0gdHJhaW5kYXRhLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgbWV0aG9kID0gImtrbm4iLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgdHVuZUdyaWQgPSBra25uVHVuZUdyaWQ0LAogICAgICAgICAgICAgICAgICAgICAgICAgICAgdHJDb250cm9sID0gZml0Q29udHJvbCkKYGBgCgpjaGVjayBwZXJmb3JtYW5jZQpgYGB7cn0KcHJlZGljdGRhdGEgPC0gcHJlZGljdChra25uVHJhaW5Nb2RlbCwgdGVzdGRhdGEpCgpwb3N0UmVzYW1wbGUocHJlZCA9IHByZWRpY3RkYXRhLCBvYnMgPSB0ZXN0ZGF0YSRIdW50ZXJzKQpgYGAKCkNoYXJ0IHBlcmZvcm1hbmNlIG9mIHByZWRpY3RlZApgYGB7cn0KY2hhcnRwZXJmb3JtYW5jZSA8LSBkYXRhLmZyYW1lKHByZWRpY3RlZCA9IHByZWRpY3RkYXRhLCBvYnNlcnZlZCA9IHRlc3RkYXRhJEh1bnRlcnMpCmBgYAoKYGBge3IgZmlnLndpZHRoPTEwfQpnZ3Bsb3QoY2hhcnRwZXJmb3JtYW5jZSwgYWVzKHByZWRpY3RlZCxvYnNlcnZlZCkpICsKICBnZW9tX3BvaW50KCkgKwogIGxhYnModGl0bGU9IlBlcmZvcm1hbmNlIG9mIE51bWJlciBvZiBIdW50ZXJzIFByZWRpY3Rpb24iLCBjYXB0aW9uPSJzb3VyY2U6IGNwdy5zdGF0ZS5jby51cyIpCmBgYAoKCgojIyBTVk0gCk91dHB1dCBmcm9tIEF6dXJlTUwKW01vZHVsZU91dHB1dF0gU3VwcG9ydCBWZWN0b3IgTWFjaGluZXMgd2l0aCBSYWRpYWwgQmFzaXMgRnVuY3Rpb24gS2VybmVsIApbTW9kdWxlT3V0cHV0XSAKW01vZHVsZU91dHB1dF0gMTU0MCBzYW1wbGVzCltNb2R1bGVPdXRwdXRdICAgIDQgcHJlZGljdG9ycwpbTW9kdWxlT3V0cHV0XSAKW01vZHVsZU91dHB1dF0gTm8gcHJlLXByb2Nlc3NpbmcKW01vZHVsZU91dHB1dF0gUmVzYW1wbGluZzogQ3Jvc3MtVmFsaWRhdGVkICgxMCBmb2xkLCByZXBlYXRlZCAxMCB0aW1lcykgCltNb2R1bGVPdXRwdXRdIApbTW9kdWxlT3V0cHV0XSBTdW1tYXJ5IG9mIHNhbXBsZSBzaXplczogMTM4NiwgMTM4NiwgMTM4NywgMTM4NywgMTM4NSwgMTM4NSwgLi4uIApbTW9kdWxlT3V0cHV0XSAKW01vZHVsZU91dHB1dF0gUmVzYW1wbGluZyByZXN1bHRzIGFjcm9zcyB0dW5pbmcgcGFyYW1ldGVyczoKW01vZHVsZU91dHB1dF0gCltNb2R1bGVPdXRwdXRdICAgQyAgICAgICAgUk1TRSAgUnNxdWFyZWQgIFJNU0UgU0QgIFJzcXVhcmVkIFNECltNb2R1bGVPdXRwdXRdICAgMC4yNSAgICAgMjc2ICAgMC45NDYgICAgIDMwLjYgICAgIDAuMDA4MjIgICAgCltNb2R1bGVPdXRwdXRdICAgMC41ICAgICAgMjAzICAgMC45NiAgICAgIDIxLjQgICAgIDAuMDA3NTQgICAgCltNb2R1bGVPdXRwdXRdICAgMSAgICAgICAgMTgwICAgMC45NjUgICAgIDE3LjcgICAgIDAuMDA2NzEgICAgCltNb2R1bGVPdXRwdXRdICAgMiAgICAgICAgMTY4ICAgMC45NjkgICAgIDE1LjcgICAgIDAuMDA2MTQgICAgCltNb2R1bGVPdXRwdXRdICAgNCAgICAgICAgMTU4ICAgMC45NzIgICAgIDE0LjkgICAgIDAuMDA1NSAgICAgCltNb2R1bGVPdXRwdXRdICAgOCAgICAgICAgMTUwICAgMC45NzUgICAgIDE0LjcgICAgIDAuMDA1MDYgICAgCltNb2R1bGVPdXRwdXRdICAgMTYgICAgICAgMTQ2ICAgMC45NzYgICAgIDE0LjcgICAgIDAuMDA0ODEgICAgCltNb2R1bGVPdXRwdXRdICAgMzIgICAgICAgMTQ0ICAgMC45NzYgICAgIDE0LjcgICAgIDAuMDA0NzcgICAgCltNb2R1bGVPdXRwdXRdICAgNjQgICAgICAgMTQzICAgMC45NzcgICAgIDE0LjYgICAgIDAuMDA0NzQgICAgCltNb2R1bGVPdXRwdXRdICAgMTI4ICAgICAgMTQwICAgMC45NzcgICAgIDE0LjMgICAgIDAuMDA0NjkgICAgCltNb2R1bGVPdXRwdXRdICAgMjU2ICAgICAgMTM5ICAgMC45NzggICAgIDE1ICAgICAgIDAuMDA0ODUgICAgCltNb2R1bGVPdXRwdXRdICAgNTEyICAgICAgMTM3ICAgMC45NzggICAgIDE0LjkgICAgIDAuMDA0ODQgICAgCltNb2R1bGVPdXRwdXRdICAgMTAyMCAgICAgMTM2ICAgMC45NzkgICAgIDE1LjMgICAgIDAuMDA0OTQgICAgCltNb2R1bGVPdXRwdXRdICAgMjA1MCAgICAgMTM1ICAgMC45NzkgICAgIDE1LjYgICAgIDAuMDA1MTMgICAgCltNb2R1bGVPdXRwdXRdICAgNDEwMCAgICAgMTM2ICAgMC45NzkgICAgIDE1LjUgICAgIDAuMDA1MSAgICAgCltNb2R1bGVPdXRwdXRdICAgODE5MCAgICAgMTM3ICAgMC45NzggICAgIDE1LjcgICAgIDAuMDA1MTggICAgCltNb2R1bGVPdXRwdXRdICAgMTY0MDAgICAgMTM5ICAgMC45NzggICAgIDE2LjUgICAgIDAuMDA1NTEgICAgCltNb2R1bGVPdXRwdXRdICAgMzI4MDAgICAgMTQxICAgMC45NzcgICAgIDE3LjYgICAgIDAuMDA2ICAgICAgCltNb2R1bGVPdXRwdXRdICAgNjU1MDAgICAgMTQ1ICAgMC45NzYgICAgIDE5LjQgICAgIDAuMDA2NTkgICAgCltNb2R1bGVPdXRwdXRdICAgMTMxMDAwICAgMTUxICAgMC45NzQgICAgIDIwLjggICAgIDAuMDA3MTggICAgCltNb2R1bGVPdXRwdXRdICAgMjYyMDAwICAgMTYxICAgMC45NyAgICAgIDI3LjIgICAgIDAuMDEwNCAgICAgCltNb2R1bGVPdXRwdXRdICAgNTI0MDAwICAgNDc4ICAgMC44ICAgICAgIDMyNSAgICAgIDAuMTcyICAgICAgCltNb2R1bGVPdXRwdXRdICAgMTA1MDAwMCAgMTE4MCAgMC41ICAgICAgIDEwMTAgICAgIDAuMjA0ICAgICAgCltNb2R1bGVPdXRwdXRdICAgMjEwMDAwMCAgMzI0MCAgMC4xNDggICAgIDIyNjAgICAgIDAuMTE3ICAgICAgCltNb2R1bGVPdXRwdXRdICAgNDE5MDAwMCAgNjAwMCAgMC4wNjA0ICAgIDY0MDAgICAgIDAuMDUyNyAgICAgCltNb2R1bGVPdXRwdXRdIApbTW9kdWxlT3V0cHV0XSBUdW5pbmcgcGFyYW1ldGVyICdzaWdtYScgd2FzIGhlbGQgY29uc3RhbnQgYXQgYSB2YWx1ZSBvZiAwLjAwMzc2NTMKW01vZHVsZU91dHB1dF0gUk1TRSB3YXMgdXNlZCB0byBzZWxlY3QgdGhlIG9wdGltYWwgbW9kZWwgdXNpbmcgIHRoZSBzbWFsbGVzdCB2YWx1ZS4KW01vZHVsZU91dHB1dF0gVGhlIGZpbmFsIHZhbHVlcyB1c2VkIGZvciB0aGUgbW9kZWwgd2VyZSBzaWdtYSA9IDAuMDAzNzcgYW5kIEMgPSAyMDQ4LiAKCgojIHJ1biBhZ2FpbiB3aXRoIGEgdHVuZSBncmlkCmBgYHtyfQpzdm1SYWRUdW5lR3JpZCA8LSBkYXRhLmZyYW1lKC5zaWdtYSA9IGMoMC4wMDM3NjUzLDAuMDAzNzY1MywwLjAwMzc2NTMsMC4wMDM3NjUzLDAuMDAzNzY1MyksCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAuQyA9IGMoMjA0OCouNywyMDQ4Ki45LDIwNDgsMjA0OCoxLjEsMjA0OCoxLjMpKQoKZml0Q29udHJvbCA8LSB0cmFpbkNvbnRyb2woCiAgbWV0aG9kID0gInJlcGVhdGVkY3YiLCAjcmVwZWF0ZWRjdiwgCiAgbnVtYmVyID0gMTAsICM0CiAgcmVwZWF0cyA9IDEwLCAjMTAKICBhbGxvd1BhcmFsbGVsID0gVFJVRSwKICBzdW1tYXJ5RnVuY3Rpb24gPSBkZWZhdWx0U3VtbWFyeSkKCnJlZ2lzdGVyRG9TRVEoKQpyZWdpc3RlckRvTUMoY29yZXMgPSA2KQoKc3ZtUmFkR3JpZE1vZGVsID0gdHJhaW4oSHVudGVycyB+IC4sIGRhdGEgPSBDT0Vsa0h1bnRlcnMsCiAgICAgICAgICAgICAgICAgICAgICBtZXRob2QgPSAic3ZtUmFkaWFsIiwKICAgICAgICAgICAgICAgICAgICAgIHR1bmVHcmlkID0gc3ZtUmFkVHVuZUdyaWQsCiAgICAgICAgICAgICAgICAgICAgICB0ckNvbnRyb2wgPSBmaXRDb250cm9sKQpgYGAKCmBgYHtyfQpzdm1SYWRHcmlkTW9kZWwKYGBgCgoKQmVzdCBSTVNFLCBub3Qgc3VyZSB3aHkgY2FyZXQgaXMgc2VsZWN0aW5nIHBhcmFtZXRlcnMgd2l0aCBoaWdoZXIgUk1TRSwgbGV0cyBzZWxlY3QgbWFudWFsbHkKYGBge3J9ClJTTUVzdm1SYWQgPC0gZmlsdGVyKHN2bVJhZEdyaWRNb2RlbCRyZXN1bHRzLCBSTVNFID09IG1pbihSTVNFKSkKYGBgCgpydW4gYWdhaW4gd2l0aCBhIHR1bmUgZ3JpZApgYGB7cn0Kc3ZtUmFkVHVuZUdyaWQyIDwtIGRhdGEuZnJhbWUoLnNpZ21hID0gYyhSU01Fc3ZtUmFkJHNpZ21hKi43LFJTTUVzdm1SYWQkc2lnbWEqLjksUlNNRXN2bVJhZCRzaWdtYSxSU01Fc3ZtUmFkJHNpZ21hKjEuMSxSU01Fc3ZtUmFkJHNpZ21hKjEuMyksCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgLkMgPSBjKFJTTUVzdm1SYWQkQyxSU01Fc3ZtUmFkJEMsUlNNRXN2bVJhZCRDLFJTTUVzdm1SYWQkQyxSU01Fc3ZtUmFkJEMpKQoKcmVnaXN0ZXJEb1NFUSgpCnJlZ2lzdGVyRG9NQyhjb3JlcyA9IDYpCgpzdm1SYWRHcmlkTW9kZWwyID0gdHJhaW4oSHVudGVycyB+IC4sIGRhdGEgPSBDT0Vsa0h1bnRlcnMsCiAgICAgICAgICAgICAgICAgICAgICAgIG1ldGhvZCA9ICJzdm1SYWRpYWwiLAogICAgICAgICAgICAgICAgICAgICAgICB0dW5lR3JpZCA9IHN2bVJhZFR1bmVHcmlkMiwKICAgICAgICAgICAgICAgICAgICAgICAgdHJDb250cm9sID0gZml0Q29udHJvbCkKYGBgCgpgYGB7cn0Kc3ZtUmFkR3JpZE1vZGVsMgpgYGAKCmBgYHtyfQpSU01Fc3ZtUmFkIDwtIGZpbHRlcihzdm1SYWRHcmlkTW9kZWwyJHJlc3VsdHMsIFJNU0UgPT0gbWluKFJNU0UpKQpgYGAKCldvcmsgdGhydSBzb21lIHJlc2FtcGxpbmcgbWV0aG9kcyB3aXRoIGJlc3Qga2tubiBwYXJhbXMKYGBge3J9CnN2bVJhZFR1bmVHcmlkMyA8LSBkYXRhLmZyYW1lKC5zaWdtYSA9IFJTTUVzdm1SYWQkc2lnbWEsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAuQyA9IFJTTUVzdm1SYWQkQykKCnRyYWlubWV0aG9kcyA8LSBjKCJib290IiwgImJvb3Q2MzIiLCAib3B0aW1pc21fYm9vdCIsICJjdiIsICJyZXBlYXRlZGN2IiwgIkxPT0NWIiwgIkxHT0NWIiwgIm5vbmUiKQp0cmFpbm1ldGhvZHBlcmZvcm1hbmNlX2FsbCA8LSBOVUxMCmZvciAoaXRyYWlubWV0aG9kIGluIHRyYWlubWV0aG9kcykgewogIHRyYWlubWV0aG9kcGVyZm9ybWFuY2UgPC0gTlVMTAogIGZpdENvbnRyb2wgPC0gdHJhaW5Db250cm9sKAogICAgbWV0aG9kID0gaXRyYWlubWV0aG9kLAogICAgbnVtYmVyID0gMTAsICM0CiAgICByZXBlYXRzID0gMTAsICMxMAogICAgYWxsb3dQYXJhbGxlbCA9IFRSVUUsCiAgICBzdW1tYXJ5RnVuY3Rpb24gPSBkZWZhdWx0U3VtbWFyeSkKICAKICByZWdpc3RlckRvU0VRKCkKICByZWdpc3RlckRvTUMoY29yZXMgPSA2KQogIAogIHN2bVJhZFRyYWluTW9kZWwgPSB0cmFpbihIdW50ZXJzIH4gLiwgZGF0YSA9IENPRWxrSHVudGVycywKICAgICAgICAgICAgICAgICAgICAgICAgIG1ldGhvZCA9ICJzdm1SYWRpYWwiLAogICAgICAgICAgICAgICAgICAgICAgICAgdHVuZUdyaWQgPSBzdm1SYWRUdW5lR3JpZDMsCiAgICAgICAgICAgICAgICAgICAgICAgICB0ckNvbnRyb2wgPSBmaXRDb250cm9sKQogIAogIHByaW50KHN2bVJhZFRyYWluTW9kZWwpCiAgdHJhaW5tZXRob2RwZXJmb3JtYW5jZSA8LSBmaWx0ZXIoc3ZtUmFkVHJhaW5Nb2RlbCRyZXN1bHRzLCBSTVNFID09IG1pbihSTVNFKSkKICB0cmFpbm1ldGhvZHBlcmZvcm1hbmNlJHRyYWlubWV0aG9kIDwtIGl0cmFpbm1ldGhvZAogIHRyYWlubWV0aG9kcGVyZm9ybWFuY2VfYWxsIDwtIHJiaW5kLmZpbGwodHJhaW5tZXRob2RwZXJmb3JtYW5jZV9hbGwsdHJhaW5tZXRob2RwZXJmb3JtYW5jZSkKfQpgYGAKYGBge3J9CnRyYWlubWV0aG9kcGVyZm9ybWFuY2VfYWxsCmBgYAoKYGBge3J9CmZpdENvbnRyb2wgPC0gdHJhaW5Db250cm9sKAogIG1ldGhvZCA9ICJvcHRpbWlzbV9ib290IiwKICBudW1iZXIgPSAxMCwgIzQKICBhbGxvd1BhcmFsbGVsID0gVFJVRSwKICBzdW1tYXJ5RnVuY3Rpb24gPSBkZWZhdWx0U3VtbWFyeSkKCnN2bVJhZEZpbmFsVHJhaW5Nb2RlbCA9IHRyYWluKEh1bnRlcnMgfiAuLCBkYXRhID0gQ09FbGtIdW50ZXJzLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgbWV0aG9kID0gInN2bVJhZGlhbCIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICB0dW5lR3JpZCA9IHN2bVJhZFR1bmVHcmlkMywKICAgICAgICAgICAgICAgICAgICAgICAgICAgIHRyQ29udHJvbCA9IGZpdENvbnRyb2wpCgpgYGAKCnNhdmUgb2ZmIGZvciBmdXR1cmUgbG9hZGluZwpgYGB7cn0Kc2F2ZShzdm1SYWRGaW5hbFRyYWluTW9kZWwsIGZpbGUgPSAifi9fY29kZS9jb2xvcmFkby1kb3cvZGF0YXNldHMvc3ZtUmFkRmluYWxUcmFpbk1vZGVsLlJEYXRhIikKYGBgCgpiYWNrIHRvIHRyYWluIHZzIHRlc3QgZGF0YSBmb3Igb25lIG1vcmUgcGVyZm9ybWFuY2UgbWVhc3VyZSBhbmQgY2hhcnQuLi4gZXZlbiB0aG91Z2gKZm9yIGZ1dHVyZSBkYXRhIHdlIHdpbGwgdXNlIHRoZSBmaW5hbCB0cmFpbmVkIG1vZGVsCmBgYHtyfQpzdm1SYWRUcmFpbk1vZGVsID0gdHJhaW4oSHVudGVycyB+IC4sIGRhdGEgPSB0cmFpbmRhdGEsCiAgICAgICAgICAgICAgICAgICAgICAgbWV0aG9kID0gInN2bVJhZGlhbCIsCiAgICAgICAgICAgICAgICAgICAgICAgdHVuZUdyaWQgPSBzdm1SYWRUdW5lR3JpZDMsCiAgICAgICAgICAgICAgICAgICAgICAgdHJDb250cm9sID0gZml0Q29udHJvbCkKYGBgCgpjaGVjayBwZXJmb3JtYW5jZQpgYGB7cn0KcHJlZGljdGRhdGEgPC0gcHJlZGljdChzdm1SYWRUcmFpbk1vZGVsLCB0ZXN0ZGF0YSkKcG9zdFJlc2FtcGxlKHByZWQgPSBwcmVkaWN0ZGF0YSwgb2JzID0gdGVzdGRhdGEkSHVudGVycykKYGBgCgpDaGFydCBwZXJmb3JtYW5jZSBvZiBwcmVkaWN0ZWQKYGBge3IgZmlnLndpZHRoPTEwfQpjaGFydHBlcmZvcm1hbmNlIDwtIGRhdGEuZnJhbWUocHJlZGljdGVkID0gcHJlZGljdGRhdGEsIG9ic2VydmVkID0gdGVzdGRhdGEkSHVudGVycykKZ2dwbG90KGNoYXJ0cGVyZm9ybWFuY2UsIGFlcyhwcmVkaWN0ZWQsb2JzZXJ2ZWQpKSArCiAgZ2VvbV9wb2ludCgpICsKICBsYWJzKHRpdGxlPSJQZXJmb3JtYW5jZSBvZiBOdW1iZXIgb2YgSHVudGVycyBQcmVkaWN0aW9uIiwgY2FwdGlvbj0ic291cmNlOiBjcHcuc3RhdGUuY28udXMiKQpgYGAKCgpra25uIHBlcmZvcm1lZCBiZXR0ZXIgdGhhbiBzdm1SYWRpYWwgUk1TRT0xMzAgdnMgMTU0CmBgYHtyfQpGaW5hbEh1bnRlcnNtb2RlbCA8LSBra25uRmluYWxUcmFpbk1vZGVsCiMgRmluYWxIdW50ZXJzbW9kZWwgPC0gc3ZtUmFkRmluYWxUcmFpbk1vZGVsCmBgYApgYGB7cn0Kc2F2ZShGaW5hbEh1bnRlcnNtb2RlbCwgZmlsZSA9ICJ+L19jb2RlL2NvbG9yYWRvLWRvdy9kYXRhc2V0cy9GaW5hbEh1bnRlcnNtb2RlbC5SRGF0YSIpCmBgYAoKVXNlIHRoZSAyMDE4IERyYXcgZGF0YSB0byBwcmVkaWN0IHRoZSBudW1iZXIgb2YgaHVudGVycyBpbiAyMDE4CmBgYHtyfQpDT0Vsa0RyYXcyMDE4IDwtIGZpbHRlcihDT0Vsa0RyYXcsIFllYXIgPT0gMjAxOCkKQ09FbGtIdW50ZXJzMjAxOCA8LSBDT0Vsa0RyYXcyMDE4WywgY29sbmFtZXMoQ09FbGtEcmF3MjAxOCkgJWluJSBjKCJVbml0IixGaW5hbEh1bnRlcnNtb2RlbCRjb2VmbmFtZXMpXQoKQ09FbGtIdW50ZXJzMjAxOCA8LSBhcy5kYXRhLmZyYW1lKHVuaXF1ZShDT0Vsa0h1bnRlcnMkVW5pdCkpCmNvbG5hbWVzKENPRWxrSHVudGVyczIwMTgpIDwtICJVbml0IgpDT0Vsa0h1bnRlcnMyMDE4JFllYXIgPC0gMjAxOApDT0Vsa0h1bnRlcnMyMDE4IDwtIGxlZnRfam9pbihDT0Vsa0h1bnRlcnMyMDE4LGZpbHRlcihDT0Vsa0RyYXcsWWVhcj09MjAxOCkpCiMgUmVwbGFjZSB0aGUgZHJhdyBkYXRhIHRoYXQgZG9uJ3QgaGF2ZSBlbnRyaWVzIHdpdGggMApDT0Vsa0h1bnRlcnMyMDE4JERyYXduW2lzLm5hKENPRWxrSHVudGVyczIwMTgkRHJhd24pXSA8LSAwCkNPRWxrSHVudGVyczIwMTgkUXVvdGFbaXMubmEoQ09FbGtIdW50ZXJzMjAxOCRRdW90YSldIDwtIDAKCkNPRWxrSHVudGVyczIwMTggPC0gQ09FbGtIdW50ZXJzMjAxOFssIGNvbG5hbWVzKENPRWxrSHVudGVyczIwMTgpICVpbiUgYygiVW5pdCIsRmluYWxIdW50ZXJzbW9kZWwkY29lZm5hbWVzKV0KCkNPRWxrSHVudGVyczIwMTgkSHVudGVycyA8LSByb3VuZChwcmVkaWN0KEZpbmFsSHVudGVyc21vZGVsLCBDT0Vsa0h1bnRlcnMyMDE4KSkKCkNPRWxrSHVudGVyczIwMTgkSHVudGVyc1tDT0Vsa0h1bnRlcnMyMDE4JEh1bnRlcnM8MF0gPC0gMApgYGAKClNhdmUgb2ZmIHNvIHdlIGRvbid0IGhhdmUgdG8gcmVjcmVhdGUgdGhlIG1vZGVsIGV2ZXJ5dGltZSB3ZSB3YW50IHRoZSByZXN1bHRzCmBgYHtyfQpzYXZlKENPRWxrSHVudGVyczIwMTgsZmlsZT0iQ09FbGtIdW50ZXJzMjAxOC5SRGF0YSIpCmBgYAoKKioqCiMjIFRvdGFsIEVsayBIYXJ2ZXN0CiMjIyBTdGF0ZXdpZGUKR3JvdXAgc2Vhc29ucwpgYGB7cn0KQ09FbGtIdW50ZXJzU3RhdGV3aWRlIDwtIHN1bW1hcmlzZShncm91cF9ieShDT0Vsa1JpZmxlQWxsLFllYXIsVW5pdCksCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBIdW50ZXJzID0gc3VtKGMoSHVudGVycy5BbnRsZXJlZCxIdW50ZXJzLkFudGxlcmxlc3MsSHVudGVycy5FaXRoZXIpLG5hLnJtID0gVCkpCkNPRWxrSHVudGVyczIwMThiIDwtIENPRWxrSHVudGVyczIwMTgKIyBDT0Vsa0h1bnRlcnMyMDE4YiRZZWFyIDwtIGFzLmNoYXJhY3RlcihDT0Vsa0h1bnRlcnMyMDE4YiRZZWFyKQoKIyBKb2luIDIwMTggdG8gaGlzdG9yaWMgZGF0YQpDT0Vsa0h1bnRlcnNBbGwgPC0gcmJpbmQuZmlsbChDT0Vsa0h1bnRlcnNTdGF0ZXdpZGUsQ09FbGtIdW50ZXJzMjAxOGIpCgojIEdyb3VwIFVuaXRzCkNPRWxrSHVudGVyc1N0YXRld2lkZSA8LSBzdW1tYXJpc2UoZ3JvdXBfYnkoQ09FbGtIdW50ZXJzQWxsLFllYXIpLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIEh1bnRlcnMgPSBzdW0oSHVudGVycykpCmBgYAoKYGBge3IgZmlnLndpZHRoPTEwfQpnZ3Bsb3QoQ09FbGtIdW50ZXJzU3RhdGV3aWRlLCBhZXMoWWVhcixIdW50ZXJzKSkgKwogIGdlb21fYmFyKHN0YXQ9ImlkZW50aXR5IixmaWxsPWdndGhlbWVzX2RhdGEkaGMkcGFsZXR0ZXMkZGVmYXVsdFsyXSkgKwogIGNvb3JkX2NhcnRlc2lhbih5bGltID0gYygxMzAwMDAsMTU1MDAwKSkgKwogIGxhYnModGl0bGU9IlN0YXRld2lkZSBFbGsgSHVudGVycyIsIGNhcHRpb249InNvdXJjZTogY3B3LnN0YXRlLmNvLnVzIikKYGBgCgoKPiBUT0RPIGNvbW1lbnRhcnkKCioqKgoKIyMjIEh1bnRlcnMgYnkgVW5pdApJJ2QgbGlrZSB0byBrbm93IHdoZXJlIHRoZSBodW50ZXJzIGFyZSBkaXN0cmlidXRlZCBhY3Jvc3MgdGhlIHN0YXRlLgoKTmV4dCB5ZWFyJ3MgZGF0YQpgYGB7cn0KWWVhcjIwMTggPC0gZmlsdGVyKENPRWxrSHVudGVyc0FsbCwgWWVhciA9PSAiMjAxOCIpCkh1bnRlcnN0b1Bsb3QgPC0gbGVmdF9qb2luKFVuaXRib3VuZGFyaWVzMixZZWFyMjAxOCwgYnk9YygiVW5pdCIpKQpgYGAKYGBge3IgZmlnLndpZHRoPTEwLCBmaWcuaGVpZ2h0PTguNDZ9CmdncGxvdChIdW50ZXJzdG9QbG90LCBhZXMobG9uZywgbGF0LCBncm91cCA9IGdyb3VwKSkgKyAKICBnZW9tX3BvbHlnb24oYWVzKGZpbGwgPSBIdW50ZXJzKSxjb2xvdXIgPSAiZ3JleTUwIiwgc2l6ZSA9IC4yKSArICNVbml0IGJvdW5kYXJpZXMKICBnZW9tX3BhdGgoZGF0YSA9IENPcm9hZHMsYWVzKHggPSBsb25nLCB5ID0gbGF0LCBncm91cCA9IGdyb3VwKSwgY29sb3I9IiMzODc4QzciLHNpemU9MikgKyAjUm9hZHMKICBnZW9tX3RleHQoZGF0YT1kYXRhX2NlbnRyb2lkcyxhZXMoeD1sb25naXR1ZGUseT1sYXRpdHVkZSxsYWJlbCA9IFVuaXQpLHNpemU9MykgKyAjVW5pdCBsYWJlbHMKICBzY2FsZV9maWxsX2Rpc3RpbGxlcihwYWxldHRlID0gIk9yYW5nZXMiLGRpcmVjdGlvbiA9IDEsbmEudmFsdWUgPSAnbGlnaHQgZ3JleScpICsKICB4bGFiKCIiKSArIHlsYWIoIiIpICsKICBsYWJzKHRpdGxlPSJQcmVkaWN0ZWQgMjAxOCBDb2xvcmFkbyBFbGsgSHVudGVycyIsIGNhcHRpb249InNvdXJjZTogY3B3LnN0YXRlLmNvLnVzIikKYGBgCgoKPiBUT0RPIC0gY29tbWVudGFyeQoKKioqCgojIyMgWWVhciB0byBZZWFyIEh1bnRlciBUcmVuZHMKQ3JlYXRlIGEgcG5nIG9mIGVhY2ggeWVhcgpgYGB7cn0KaWNvdW50ZXIgPC0gMApmb3IgKGltYXAgaW4gdW5pcXVlKENPRWxrSHVudGVyc0FsbCRZZWFyKSl7CiAgIyBDb2xvcmFkbyBhc3BlY3QgcmF0aW8gPSAxMDg3dyB4IDgwMGggLT4gMS4zNTg3NQogICMgVXNlIHRyaWFsIGFuZCBlcnJvciB0byBkZXRlcm1pbmUgd2hpY2ggd2lkdGggYW5kIGhlaWdodCB0byBkZWZpbmUgZm9yIHBuZyBmaWxlcyB0aGF0IHdpbGwgcmV0YWluIHRoZSBjb3JyZWN0IGFzcGVjdCByYXRpbwogIHBuZyhmaWxlPXBhc3RlKCJIdW50ZXJzTWFwIixpbWFwLCIucG5nIiksIHdpZHRoPTk0OCwgaGVpZ2h0PTcwMCkKICB5ZWFycGxvdCA8LSBmaWx0ZXIoQ09FbGtIdW50ZXJzQWxsLCBZZWFyID09IGltYXApCiAgSHVudGVyc3RvUGxvdCA8LSBsZWZ0X2pvaW4oVW5pdGJvdW5kYXJpZXMyLHllYXJwbG90LCBieT1jKCJVbml0IikpCiAgcDEgPC0gZ2dwbG90KEh1bnRlcnN0b1Bsb3QsIGFlcyhsb25nLCBsYXQsIGdyb3VwID0gZ3JvdXApKSArIAogICAgZ2VvbV9wb2x5Z29uKGFlcyhmaWxsID0gSHVudGVycyksY29sb3VyID0gImdyZXk1MCIsIHNpemUgPSAuMikgKyAjVW5pdCBib3VuZGFyaWVzCiAgICBnZW9tX3BhdGgoZGF0YSA9IENPcm9hZHMsYWVzKHggPSBsb25nLCB5ID0gbGF0LCBncm91cCA9IGdyb3VwKSwgY29sb3I9IiMzODc4QzciLHNpemU9MikgKyAjUm9hZHMKICAgIGdlb21fdGV4dChkYXRhPWRhdGFfY2VudHJvaWRzLGFlcyh4PWxvbmdpdHVkZSx5PWxhdGl0dWRlLGxhYmVsID0gVW5pdCksc2l6ZT01KSArICNVbml0IGxhYmVscwogICAgc2NhbGVfZmlsbF9kaXN0aWxsZXIocGFsZXR0ZSA9ICJPcmFuZ2VzIiwKICAgICAgICAgICAgICAgICAgICAgICAgIGRpcmVjdGlvbiA9IDEsCiAgICAgICAgICAgICAgICAgICAgICAgICBuYS52YWx1ZSA9ICdsaWdodCBncmV5JywKICAgICAgICAgICAgICAgICAgICAgICAgIGxpbWl0cyA9IGMoMCxtYXgoQ09FbGtIdW50ZXJzQWxsJEh1bnRlcnMpKSkgKyAjZml4IHNvIGVhY2ggeWVhciBjaGFydCBoYXMgc2FtZSBjb2xvciBicmVha3MKICAgIHhsYWIoIiIpICsgeWxhYigiIikgKwogICAgdGhlbWUocGxvdC50aXRsZT1lbGVtZW50X3RleHQoaGp1c3QgPSAuNSkpICsKICAgIHRoZW1lKHBsb3Quc3VidGl0bGU9ZWxlbWVudF90ZXh0KGhqdXN0ID0gaWNvdW50ZXIvbGVuZ3RoKHVuaXF1ZShDT0Vsa0h1bnRlcnNBbGwkWWVhcikpKSkgKwogICAgbGFicyh0aXRsZT0iQ29sb3JhZG8gRWxrIEh1bnRlcnMiLCBzdWJ0aXRsZT1pbWFwLCBjYXB0aW9uPSJzb3VyY2U6IGNwdy5zdGF0ZS5jby51cyIpCiAgcGxvdChwMSkKICBkZXYub2ZmKCkKICBpY291bnRlciA8LSBpY291bnRlciArIDEKfQpgYGAKQ29udmVydCB0aGUgLnBuZyBmaWxlcyB0byBvbmUgLmdpZiBmaWxlIHVzaW5nIEltYWdlTWFnaWNrLiAKYGBge3J9CnN5c3RlbSgiY29udmVydCAtZGVsYXkgMTUwICoucG5nIEh1bnRlcnNtYXBQcmVkLmdpZiIpCmBgYAoKIVtdKEh1bnRlcnNtYXBQcmVkLmdpZikKPiBUT0RPIC0gY29tbWVudGFyeQoKUmVtb3ZlIHRoZSAucG5nIGZpbGVzCmBgYHtyfQpmaWxlLnJlbW92ZShsaXN0LmZpbGVzKHBhdHRlcm49Ii5wbmciKSkKYGBgCgoqKioKIyMjIE51bWJlciBvZiBIdW50ZXJzIFJhbmsgb2YgdGhlIFVuaXRzCldvdWxkIGFsc28gYmUgYmVuZWZpY2lhbCB0byByYW5rIGVhY2ggdW5pdCBzbyBJIGNhbiByZWZlcmVuY2UgbGF0ZXIuIEluIHRoaXMgY2FzZQphdmVyYWdlIHRoZSBudW1iZXIgb2YgaHVudGVycyBvZiB0aGUgbGFzdCBmZXcgeWVhcnMKYGBge3J9Ckh1bnRlclJhbmsyMDE4IDwtIGZpbHRlcihDT0Vsa0h1bnRlcnNBbGwsIGFzLm51bWVyaWMoWWVhcikgPT0gMjAxOCkKSHVudGVyUmFuazIwMTggPC0gc3VtbWFyaXNlKGdyb3VwX2J5KEh1bnRlclJhbmsyMDE4LFVuaXQpLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgIEh1bnRlcnMgPSBtZWFuKEh1bnRlcnMsbmEucm0gPSBUKSkKSHVudGVyUmFuazIwMTgkSHVudGVyc1JhbmsgPSByYW5rKC1IdW50ZXJSYW5rMjAxOCRIdW50ZXJzKQoKSHVudGVyUmFuazIwMTggPC0gZmlsdGVyKEh1bnRlclJhbmsyMDE4LCBIdW50ZXJzUmFuayA8PSA1MCkgIyB0b3AgNTAgdW5pdHMKIyBJbiBvcmRlciBmb3IgdGhlIGNoYXJ0IHRvIHJldGFpbiB0aGUgb3JkZXIgb2YgdGhlIHJvd3MsIHRoZSBYIGF4aXMgdmFyaWFibGUgKGkuZS4gdGhlIGNhdGVnb3JpZXMpIGhhcyB0byBiZSBjb252ZXJ0ZWQgaW50byBhIGZhY3Rvci4KSHVudGVyUmFuazIwMTggPC0gSHVudGVyUmFuazIwMThbb3JkZXIoLUh1bnRlclJhbmsyMDE4JEh1bnRlcnMpLCBdICAjIHNvcnQKSHVudGVyUmFuazIwMTgkVW5pdCA8LSBmYWN0b3IoSHVudGVyUmFuazIwMTgkVW5pdCwgbGV2ZWxzID0gSHVudGVyUmFuazIwMTgkVW5pdCkgICMgdG8gcmV0YWluIHRoZSBvcmRlciBpbiBwbG90LgpgYGAKCkxvbGxpcG9wIENoYXJ0CmBgYHtyfQpnZ3Bsb3QoSHVudGVyUmFuazIwMTgsIGFlcyh4PVVuaXQsIHk9SHVudGVycykpICsgCiAgZ2VvbV9wb2ludChzaXplPTMpICsgCiAgZ2VvbV9zZWdtZW50KGFlcyh4PVVuaXQsIAogICAgICAgICAgICAgICAgICAgeGVuZD1Vbml0LCAKICAgICAgICAgICAgICAgICAgIHk9MCwgCiAgICAgICAgICAgICAgICAgICB5ZW5kPUh1bnRlcnMpKSArIAogIGxhYnModGl0bGU9IlByZWRpY3RlZCBFbGsgSHVudGVycyAyMDE4XG5Ub3AgNTAgVW5pdHMiLCBzdWJ0aXRsZT0iSHVudGVycyBieSBVbml0IiwgY2FwdGlvbj0ic291cmNlOiBjcHcuc3RhdGUuY28udXMiKQpgYGAKCj4gVE9ETyAtIGNvbW1lbnRhcnkKCioqKgojIyBDb25jbHVzaW9uCj4gVE9ETwoKCg==